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Preface 


The  purpose  of  this  study  was  to  ascertain  to  what  degree  the  current  DOD 
training,  as  outlined  in  DOD  5000. 52M,  is  sufficiently  meeting  the  needs  of  Air  Force 
contracting  personnel.  Surveys  were  administered  to  Air  Force  contracting  personnel 
attending  Professional  Continuing  Education  courses.  Students  were  surveyed  on  their 
attitudes,  perceptions,  and  belief  concerning  the  certification  program,  the  training 
program,  and  the  competencies  which  are  used  to  build  the  training  courses.  The  training 
program  was  viewed  as  sufficient  by  a  slight  majority  of  the  respondents.  Interesting 
viewpoints  were  also  determined  concerning  the  other  career  development  program 
components  *  experience  and  education  -  as  well  as  various  other  aspects  of  training. 
Since  this  research  was  the  first  in  the  career  development  program  arena,  numerous 
areas  for  further  research  have  been  identified  as  a  result  of  this  study. 
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Abstract 


This  study  determined  to  what  extent  AF  contracting  personnel  training  needs  are 
sufficiently  being  satisfied  by  the  current  DOD  training  as  outlined  in  DOF  5000. 52M. 

A  convenience  sample  was  employed.  499  surveys  were  administered  to  Professional 
Continuing  Education  students  for  various  level  1  through  111  courses.  320  surveys  were 
used  for  the  data  base,  achieving  a  64. 1%  response  rate.  The  results  of  this  study  show 
that  the  training  requirements  were  viewed  as  sufficiently  ensuring  that  the  AF  has  a 
mission  ready  professional  work  force  by  slightly  more  than  half  of  the  respondents 
However,  the  training  component  was  ranked  as  the  most  important  component  of  the 
career  development  program  by  the  fewest  number  of  respondents.  Respondents 
indicated  the  need  for  improvement  in  the  areas  of  specificity  and  timeliness  of  training. 
The  training  courses  were  perceived  as  overall  adequate  in  meeting  respondent  needs 
Key  competencies  for  review  were  identified  based  on  upward  trend  and  correlational 
analysis. 
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THE  CERTIFICATION  PROGRAM,  TRAINING,  AND  COMPETENCIES  AN 
EXAMINATION  OF  THE  AIR  FORCE  CONTRACTING  WORK  FORCE’S 
RESPONSE  TO  THE  SUFFICIENCY  OF  PROFESSIONAL  TRAINING 


I.  Introduction 


General  Issue 

The  Defense  Acquisition  Work  Force  Improvement  Act  (DAWIA)  of  1990  was 
enacted  to  ensure  the  development  of  a  quality  acquisition  work  force  to  maintain  die 
integrity  of  the  defense  acquisition  system.  To  meet  the  challenges  of  the  defense 
acquisition  system  of  tomorrow,  DAWIA  established  standardized  criteria  governing  the 
experience,  training,  and  education  of  acquisition  personnel.  These  regulatory 
requirements  and  other  guidance  were  captured  in  Department  of  Defense  (DOD) 
Directive  5000.52,  "Defense  Acquisition  Hducalion,  Training,  and  Career  Development 
Program"  and  DOD  Manual  5000. 52M,  "Career  Development  Program  for  Acquisition 
Personnel,"  which  govern  the  program  policy  and  procedures.  As  a  result  of  DAWIA  and 
the  subsequent  directive,  DOD  5000.52,  the  Air  force  ( AF)  initiated  the  Acquisition 
Professional  Development  Program  (APDP)  to  provide  the  Air  Force  acquisition 
community  with  a  revitalized  version  of  a  career  development  program  to  ensure  all 
acquisition  personnel  receive  the  necessary  experience,  training,  and  education  to 
effectively  progress  into  more  responsible  and  demanding  positions.  Brigadier  General 
Robert  Drewes,  United  States  Air  Force,  Deputy  Assistant  for  Contracting,  indicated  the 
need  for  a  professional  development  program  which  capitalizes  on  the  Air  Force's  most 
valuable  resource  -  "people." 


The  Air  Force  continues  to  change  in  shape  and  sice  to  belter  meet 
America's  defense  needs.  We  have  a  new,  forward-reaching  vision  - 
Global  Power  and  Reach  for  America.  The  business  we  are  in,  our 
mission,  has  been  recently  updated  -  to  defend  the  United  States  through 
(he  control  and  exploitation  of  air  and  space.  Contracting's  contribution 
to  tomorrow's  Air  Force  is  also  clear  -  we  acquire  the  supplies  and 
services  essential  to  the  Air  Force's  daily  operations  and  war-fighting 
mission  in  a  manner  that  supports  customers'  needs  at  reasonable  prices, 
meets  all  statutory  and  regulatory  requirements,  and  inspires  public  trust. 

It  is  a  challenging  and  awesome  responsibility. 

While  contracting  is  an  integral  part  of  the  Air  Force  team,  we  are 
unique.  We  do  not  rely  on  large  "capital  investments"  in  real  estate, 
buildings,  machinery,  and  equipment  to  get  the  job  done.  It  is  our  people 
a  dedicated,  professional  contracting  team,  more  than  10,000  strong,  that 
turns  critical  requirements  and  scarce  dollars  into  air  and  space  power. 

(Prewes.  109S:  23 j 

This  research  reviewed  the  sufficiency  of  the  overall  cenificatior.  program  as 
outlined  in  DOD  5000. 52M.  Specifically,  the  study  sought  to  identify  the  sufficiency  of 
the  current  training  requirements  of  the  certification  program.  As  such,  the  research 
effort  identified  to  what  degree  Air  Force  contracting  personnel  believe  the  training 
requirements  are  sufficiently  meeting  their  needs  in  pursuit  of  satisfying  the  mission  and 
attaining  a  more  professional  work  force.  Training  was  targeted  as  the  primary  focus  of 
the  three  components  -  experience,  training,  and  education  -  of  the  professional 
development  program. 

The  key  to  professional  development  and  mission  success  continues  to  be 
training.  We  identify  the  competencies  our  people  need  across  the  total 
contracting  function  in  order  to  perform  their  responsibilities.  We  then 
provide  training  using  many  approaches,  from  formal,  in-residence 
courses  to  OJT  (On-  the-Job  Training)  at  the  work  place. 

(Dr ewes,  1993:  25) 

The  need  has  been  identified  for  experienced,  trained,  and  educated  acquisition 
personnel  to  meet  the  challenges  of  tomorrow's  defense  acquisition  system  and  the 
operating  environment  therein.  DAWIA  and  DOD  wide  programs  have  been 
implemented  to  help  ensure  this  need  is  successfully  satisiied.  Training  plays  a 
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substantia!  role  in  satisfying  this  objective  As  such,  it  was  vital  to  determine  the  extent 
to  which  the  current  training  is  sufificientlv  meeting  the  needs  of  AF  contracting 
personnel. 


Problem  Statement 

The  question  for  this  research  effort  involved  the  determination  to  what  extent  Air 
Force  contracting  personnel  training  needs  are  sufficiently  being  satisfied  by  the  current 
DOD  training  as  outlined  in  DOD  5000. 52M. 


Research  Objectives 

The  purpose  of  this  research  was  to  ascertain  to  what  degree  the  current  DOD 
training,  as  outlined  in  DOD  5000. 52M,  is  sufficiently  meeting  the  needs  of  Air  Force 

4 

contracting  personnel.  This  objective  was  accomplished  by  answering  the  following 
investigative  questions: 

1 .  To  what  extent  was  the  naming  component  of  the  career  development  program 
sufficiently  meeting  the  current  needs  of  AF  contracting  personnel'1 

2.  To  what  degree  did  level  i,  level  11,  and  level  Ill  personnel  believe  lhaL  the 
training  component  of  the  career  development  program  is  sufficiently  meeting  the  current 
needs  of  AF  contracting  personnel'1 

3.  What  types  of  training  courses  were  perceived  to  be  adequate  and  consistent 
with  personncM  needs  for  support  of  the  mission  and  the  development  of  a  professional 
work  force? 

4.  To  what  extent  is  the  individual's  perception  of  the  importance  and/or  need  for 
the  competency  in  job  performance  commensurate  with  the  proficiency  level  at  which 
the  individual  eyaluates  his/her  proficiency? 


Scope  and  Limits 

The  goal  of  the  career  professional  development  program  is  to  use  experience, 
training,  and  education  requirements  to  establish  a  professional  baseline  for  acquisition 
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personnel.  While  the  overall  perception  of  the  certification  program  was  targeted,  the 
key  emphasis  of  this  research  effort  was  the  training  component  of  the  program 
Training  was  the  only  aspect  of  the  program  targeted  because  the  role  of  training  is 
viewed  as  key  to  professional  development  and  mission  success,. 

This  research  examined  the  regulations  and  requirements,  surveyed  applicable 
contracting  personnel,  analyzed  the  findings,  and  provided  recommendations  concerning 
the  sufficiency  of  the  current  AF  contracting  training  program.  Most  of  the  analysis  was 
based  on  the  training  needs  identified  by  contracting  personnel  and  was  limited  to  the 
attitudes,  experiences,  and  perceptions  of  contracting  personnel. 

Potential  Benefits 

DOD  training  needs  are  responding  to  the  changing  requirements  of  the 
acquisition  work  force  of  tomorrow.  As  such,  DAW1A  ,  and  the  subsequent  programs  to 
implement  DAWIA,  are  in  a  state  of  continuous  change.  Therefore,  the  research  findings 
generated  from  this  study  will  be  helpful  in  guiding  the  definition  and  development  of 
the  DOD  program.  While  the  focus  of  the  study  will  target  AF  personnel,  the  results  of 
the  research  may  be  utilized  for  the  improvement  of  the  entire  DOD  program  because  the 
career  development  program  requirements  for  experience,  training,  and  education,  are 
standardized  across  all  sci  vices 

Definitions 

Contraction  Personnel:  Civilians  in  the  1 102  career  series  and  their  military  equivalents 
(Drewes,  1993.  24) 

Contraction  Officer:  The  government's  agent  for  entering  into,  administering,  and 
terminating  contracts  (FAR,  1993). 
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Defense  Acquisition:  The  planning,  design,  development,  testing,  contracting, 
production,  introduction,  acquisition  logistics  support,  and  disposal  of  systems, 
equipment,  facilities,  supplies,  or  services  that  are  intended  for  use  in,  or  in  support  of, 
military  missions  (Land,  1993:  23  2). 

Defense  Acquisition  Work  Force:  Permanent  civilian  employees  and  military  members 
who  occupy  acquisition  positions,  who  are  members  of  an  Acquisition  Corps,  or  who  are 
in  acquisition  development  programs  (Land,  1993:  23.2) 

Need:  1 .  A  lack  of  something  necessary,  useful,  or  desirable.  2.  Obligation  or 
requirement.  3.  Something  necessary,  useful,  or  des.rable:  requisite  (Websters,  19X4) 


Overview 

This  study  explored  one  aspect  of  the  professionalism  of  the  AF  contracting  work 
force  -  training  for  contracting  personnel.  Throughout  the  remainder  oi  this  thesis,  the 
study  will  examine  to  what  extent  mandatory  DOD  500G.52M  training  requirements  are 
meeting  the  needs  of  AF  contracting  personnel.  Chapter  1  has  provided  a  general 
introduction  to  the  central  research  issue  Chapter  2  will  examine  the  background  of  the 
problem  and  provide  sources  of  literature  to  substantiate  the  problem  area.  Chapter  3 
will  describe  the  research  design  and  methodology  issues  relevant  to  this  study.  Chapter 
4  will  address  the  analysis  and  findings  of  the  study  Chapter  5  will  explore  the 
conclusions,  recommendations,  and  closing  comments  relevant  to  this  research. 
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II.  Literature  Review 


Chapter  Overview 

This  chapter  focuses  on  the  development  and  establishment  of  Defense 
Acquisition  Work  Force  Improvement  Act  (DAW1A),  and  the  subsequent  issuance  of 
DOD  Manual  5000.52M  which  documents  the  policies  and  procedures  of  the 
professionalism  program.  This  literature  review  examines  applicable  secondary  sources 
and  provides  a  review  of  the  available  background  information.  Secondary  data  will 
fulfill  two  of  the  three  research  purposes  outlined  by  Emory  and  Cooper  it  will  1 ) 
provide  specific  references  pertaining  to  the  study  and,  2)  provide  early  exploration  and 
background  information  contributing  to  the  study  (Emory  and  Cooper,  1991). 


The  Defense  Acquisition  Work  Force  Improvement  Act  (DAWIA) 

From  the  Hoover  commission  of  1949  to  the  Packard  Commission  of  1986,  public 
concern  for  the  quality  and  professionalism  of  the  defense  acquisition  work  force  has 
been  prevalent.  The  public  outcry  concerning  the  acquisition  horror  stones  in  the  1980's 


provided  the  push  for  a  federal  mandate  to  establish  a  quality  acquisition  work  fore 
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established  experience,  training,  and  education  requirements.  A  1990  Congressional 
report  pointed  to  the  three  key  areas  of  the  defense  acquisition  system  for  potential 
modifications:  1)  the  process,  2)  the  structure,  and  3)  the  people.  The  report  noted  that 
although  the  process  and  structure  aspects  of  the  system  had  been  modified  to  try  to 
attain  a  more  efficient  and  effective  acquisition  system,  the  people  aspect  of  the  system 
had  not  been  tackled  (Land,  1993:  23.2)  As  Congressman  Nicholas  Mavroules  stated. 
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Improving  the  DOD's  acquisition  process  is  one  of  our  country's  most 
pressing  national  security  problems.  By  addressing  the  people  issue,  we 
take  a  big  step  in  that  direction.  (Mavroules,  1991:  23) 

The  various  executive  commissions  pointed  to  the  need  to  "attract  and  retain  the  caliber 

of  people  necessary  for  a  quality  acquisition  program"  (Land,  1993:  23.5).  As  the 

Packard  Commission  concluded. 


. .  .training  should  be  centrally  managed  and  funded  to  improve  utilization 
of  teaching  faculty,  to  enforce  compliance  with  mandatory  training 
requirements,  and  to  coordinate  overall  acquisition  training  policies. 

(Land.  1993:  23.5) 

A  clear  need  to  prepare  the  work  force  with  professional  training  and  education  had  been 
identified. 

Congress  enacted  DAWIA  in  November  1990  to  reform  the  acquisition  work 
force.  This  legislation  provided  the  framework  necessary  to  improve  the  effectiveness  of 
the  acquisition  work  force.  DAWIA  was  a  part  of  the  legislation  the  House  passed  within 
the  National  Defense  Authorization  Act,  H.R.  4739,  Public  Law  101-510,  Title  Xll 
(Mavroules,  1991:  16).  To  ensure  a  quality  and  professional  work  force,  DAWIA 
established  the  following  (Livingston,  1993): 


1.  Separate  career  boards  for  acquisition  fields  (Contracting,  Program 
Management,  and  so  on). 

2.  Distinct  career  paths  for  the  fields. 

3.  Critical  and  non-critical  acquisition  positions. 

4.  Intern,  scholarship,  and  other  recruitment  programs. 

5.  A  line  item  budget  to  support  the  mandatory  training. 

6.  The  Defense  Acquisition  University  (DAU),  the  educational  consortium. 

7.  Certification  levels  (Level  I,  II,  III)  determined  by  standard  education, 
training,  and  experience  requirements. 

8.  An  acquisition  corps  for  performance  in  critical  positions. 

9.  Rigorous  qualification,  entry  level ,  and  promotion  requirements 

10.  Standardized  minimum  qualifications  for  civilian  and  military 

contracting  personnel  and  contracting  officers. 
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Regulatory  Guidance 


From  the  passage  of  DAWIA  in  November  1990,  regulatory  guidance  for 
DAW1A  implementation  DOD-wide  was  developed,  drafted,  and  coordinated.  DOD 
guidance  provided  six  regulations  and  manuals  concerning  DAWIA  The  regulations  and 
manuals,  subject  matter,  and  dates  issued  are  depicted  in  Table  2-1  below. 


Table  2-1.  Regulatory  Guidance  Concerning  DAWIA 


j  Regulation  or  Manual 

Subject 

Date  Issued 

DOD  5000.52  and 

DOD  5000.57 

Policy  and  Defense  Acquisition 
University  (DAU)  Establishment 

Oct  91 

DOD  5000.55  and 

DOD  5000.52M 

Certification  Standards 

Nov  9  i 

1 

DOD  5000.551 

Reporting  Management  Information 

Nov  9 1 

DOD  5000.58 

Positions,  Work  Force  and  Special 
Qualifications 

Jan  92 

DOD  5000. 52M  operates  as  the  primary  implementing  directive  of  DAWIA  as  it 


establishes  the  program's  operation  and  administration  throughout  DOD  It  outlines  the 
program's  design  as  follows  (DOD  5000. 52M,  199!  1-1). 

1 .  Attract,  select,  develop,  and  retain  on  a  long  term  basis,  a  highly 
qualified  work  force  capable  of  performing  current  and  future  DOD 
acquisition  functions. 

2.  Meet  current  and  future  DOD  needs  for  acquisition  personnel  and  to 
provide  capable  replacements  for  senior  acquisition  positions  on  a 
planned,  systematic  basis. 

3.  Increase  the  proficiency  of  DOD  acquisition  personnel  in  their  present 
positions  and  to  provide  guidance  and  opportunities  for  broadening 
experiences  and  progression  commensurate  with  their  abilities. 

4.  Improve  the  management  and  professionalism  of  the  acquisition  work 
force. 


5.  Incorporate  requirements  of  applicable  laws  and  directives  issued  by 
the  DOD  and  the  Office  of  Personnel  Management. 

The  AF  issued  AFR  40-1 10  "Civilian  Career  Program  Management"  in  November 
1988  and  MR  36-27,  "Officer  Personnel,  Acquisition  Professional  Development"  in 
December  1990  to  govern  a  career  development  program  for  both  military  personnel  and 
civilians.  These  regulations  were  subsequently  updated  to  include  the  DAW1A 
requirements  and  were  used  to  implement  the  DOD  directives  at  the  AF  level.  The  AF 
established  a  career  development  program  which  became  known  as  the  Air  Force 
Professional  Development  Program  ( APDP,  1992).  AFR  40-1 10  and  36-27  were 
rescinded  in  March  1992  when  the  Secretary  of  the  Air  Force  for  Acquisition  (SAF  AQ) 
issued  a  policy  letter  which  spelled  out  requirements  for  certification  under  APDP.  This 
policy  letter  governed  the  program  until  December  1993.  In  December  1993,  a 
subsequent  policy  letter  was  issued  establishing  new  guidelines  for  all  acquisition 
functions. 

APDP  was  "designed  to  provide  the  acquisition  community  with  a  structure  that 
ensures  our  ( AF)  people  get  the  necessary  training,  education,  and  experience  to 
effectively  progress  into  more  responsible  and  demanding  positions"  (APDP,  1992  2). 
Later  AF  policy  letters  raised  certification  standards  for  AF  personnel  higher  than  those 
standards  required  by  DOD  DOD  reviewed  the  APDP  increased  standards  and 
determined  that  military  services  shall  not  be  able  to  place  more  stringent  requirements 
upon  personnel  than  those  requirements  outlined  in  DOD  5000.52M.  This  determination 
was  outlined  in  the  December  1993  policy  letter  and  has  standardized  certification 
requirements  for  all  the  military  services.  A  new  version  of  DOD  5000. 52M  will  be 
issued  in  the  Fall  of  1994  implementing  this  revision.  DOD  requirements  for  each 
certification  level  in  contracting  are  indicated  in  Table  2-2 


Table  2-2.  Professional  Certification  Requirements  -  Contracting 


Level 

Experience 

Training 

1  Education 

I 

1  year 

Contracting  Fundamentals 

Contract  Pricing 

Degree  or  ; 

24  hours  of  business  1 

11 

2  years 

Government  Contract  Law 
Intermediate  Contract  Pricing 
Intermediate  Contracting  Course 
in  Primary  Assignment 

Same  as  Level  1 

Ul 

4  years 

Executive  Contracting 

Executive  Contracting  Course 
in  Primary  Assignment 

Same  as  Level  1 

Polio  l.ctlcr.  1  )CC 


The  primary  change  to  the  contracting  function  was  the  reduction  of  the 
experience  requirements  from  one,  lour,  and  eight  years  to  one,  two,  and  four  years, 
respectively.  Additionally,  the  AF  can  no  longer  require  80  hours  of  management 
training  for  level  III  contracting  certification.  Finally,  to  ensure  that  DAW1A  and  DOD 
are  consistent,  the  Professional  Military'  Education  (PME)  requirements  will  no  longer  be 
mandatory  for  military  personnel. 


Competency  Based  Education  (CBE) 

In  1986,  DOD  directed  a  comprehensive  review  of  the  contracting,  quality 
assurance,  and  program  management  work  force  To  help  establish  the  parameters  for 
the  training  and  education  requirements  within  the  program,  the  Defense  Systems 
Management  College  (DSMC)  established  a  review  board  comprised  of  representatives 
from  all  of  the  services  and  the  Defense  Logistics  Agency  (DLA).  This  board  conducted 
an  extensive  review  which  resulted  in  the  Acquisition  Enhancement  Program  (ACE) 
Report,  Vol  1,  outlining  the  experience,  training,  and  education  requirements  for  fifteen 
various  acquisition  functions.  The  board  also  drafted  DOD  Directives  5000.48  and 
5000.23  and  recommended  the  formation  of  a  central  defense  acquisition  universitv 


The  need  for  maximum  return  on  funds,  instructors,  students,  time,  and  facilities 
required  the  board  to  establish  standards  for  Competency  Based  Education  (CBE). 
McAshan  defines  CBE  as  containing  three  elements:  1 )  specific  competencies, 

2)  objectives  and  strategies  to  help  achieve  the  established  competencies,  and  3) 
evaluation  policies  to  assess  it  the  student  has  achieved  the  desired  level  of  learning 
(McAshan,  38).  The  Under  Secretary  of  Defense  (Acquisition  and  Logistics) 
implemented  CBE  at  numerous  service  schools  in  1986.  At  present,  all  Defense 
Acquisition  University  consortium  schools  utilize  CBE  to  accomplish  the  training 
objectives  set  forth  under  DOD  5000. 52M. 

A  subsequent  study,  ACE  11,  was  accomplished  in  May  of  1986.  The  study  found 
that  there  was  an  overwhelming  student  population  awaiting  training  per  the  required 
training  curriculum.  The  report  predicted  that  with  the  recommended  requirements  of 
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training.  ACE  11  called  for  a  "coordinated  effort  that  crosses  individual  and  Auencv 
lines"  (Committee  on  Armed  Services,  1990.430).  This  provided  the  impetus  for  the 
establishment  of  the  Defense  Acquisition  University  (DAU)  The  DAU  was  officially 
dedicated  in  October  1992  with  the  primary  mission  "  to  prepare  professionals  for 
effective  service  in  the  DOD  acquisition  work  force"  (Sobteszczyk,1993: 1 5 ). 


Need  for  Follow-up 

As  this  literature  review  has  indicated,  numerous  changes  have  been  a  part  of  the 
history  of  the  evolution  of  the  career  development  program.  However,  there  has  been 
little  or  no  scientific  study  or  follow-up  to  determine  how  these  changes  have  actually 
affected  the  sufficiency  of  the  program.  There  is  a  need  for  such  an  evaluation  to  prov  ide 
a  program  baseline  from  which  a  reference  point  can  be  established  to  determine  exactly 
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how  each  of  the  changes  to  the  certification  program  are  affecting  the  quality  and 
professionalism  of  the  work  force. 


Key  Definitions 

DAWIA  intends  to  provide  a  professional  work  force  through  "experience," 
"training,"  and  "education,"  therefore  these  terms  must  be  defined  for  clarity.  Several 
sources  were  examined  to  define  these  terms  in  relation  to  the  defense  acquisition  system 
and  the  goals  of  DAWIA.  After  the  sources  were  examined,  the  list  of  terms  was 
expanded  to  include  "professionalism,"  "competency,"  "certification,"  and 
"career  professional  de\elopment."  The  additional  terms  were  included  because  of  their 
relationships  to  experience,  training,  and  education,  within  the  DOD  program.  The 
terminology,  definitions,  and  sources  are  listed  below. 

Continuing  Education  and  Training:  A  mandatory  education  or  training  standard 
established  by  a  Functional  Advisor  or  Functional  Board,  which  is  determined  to  be 
essential  for  maintaining  currency  in  a  career  field  and  must  be  accomplished  by 
members  of  the  acquisition  work  force  in  the  career  field  for  which  the  standard  is 
established  regardless  of  the  individual's  certification  level.  (DOD  5000. 52M,  1991  :i.\) 

Experience:  Participation  or  observation  leading  to  skill  (Websters,  1984). 

Professionalism:  Professionalism  is  derived  from  the  word  profession  -  an  occupation  in 
which  one  professes  to  be  skilled.  It  also  refers  to  a  body  of  persons  engaged  in  a  calling 
Significantly,  it  derives  from  the  act  of  professing  or  publicly  declaring  entry  into  a 
religious  order  (Committee  on  Armed  Services,  1990:414). 

Competency:  Demonstrable  composite  knowledge,  skills,  abilities,  characteristics,  or 
traits  related  to  effective  task  performance  on  the  job  (McAshan,  1979:45). 

Certification:  The  process  of  formally  recognizing  completion  of  mandatory  education, 
training,  and  experience.  DOD  5000.52M,  November  1991,  lists  the  training 
requirements  for  certification  Policy  Guide,  1 994:4). 
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Career/Professional  Development:  The  professional  development  of  employee  potential 
by  integrating  the  capabilities,  needs,  interests,  and  aptitudes  of  employees  participating 
in  a  career  program  through  a  planned,  organized,  and  systematic  method  of  training  and 
development  designed  to  meet  organizational  objective.  It  is  accomplished  through  work 
assignments,  job  rotation,  training,  education,  and  self  development  programs  (DOD 
5000.52M,1991:  viii). 


Summary 

The  240,000  persons  who  are  currently  part  of  the  acquisition  work  force 
oversee  the  procurement  of  more  than  $ 120  billion  in  military  goods  and 
services  each  year.  Even  accounting  for  the  huge  budget  cuts  we 
anticipate  this  decade,  we  will  still  be  talking  about  a  procurement  system 
that  is  larger  than  the  gross  national  product  of  all  but  a  handful  of 
nations.  This  demands  skills  that  stem  from  professional ism.  from 
education  and  solid  framing,  and  from  substantial  work  experience. 

(Mavroules,  1)9! :  22 j 

* 

The  need  has  been  identified  for  experienced,  trained,  and  educated  acquisition 
personnel  to  meet  the  challenges  of  tomorrow's  defense  acquisition  system.  DAWIA  and 
DOD  wide  programs  have  been  implemented  to  try  to  ensure  these  needs  are  successfully 
met.  As  with  most  programs  striving  to  meet  the  challenges  of  tomorrow  ,  the  DOD 
training  program  must  be  reviewed  to  ensure  it  is  sufficiently  meeting  the  needs  of'  ’e 
personnel.  The  type,  variety,  and  content  of  the  courses  which  make  up  the  training 
piOgiaiii  i'riub!  uc  evaluated  tO  CiiSUFc  the  pcfSOilnci  afe  receiving  the  right  training,  at  the 
right  time,  constructed  of  the  right  material.  It  is  through  the  identification  and 
incorporation  of  the  right  mix  of  training  that  wiil  lead  the  acquisition  work  force  into  the 
future  and  accomplishing  the  mission  in  a  professional  manner.  Chapter  3  will  review 
the  methodology  employed  to  determine  to  what  degree  the  current  DOD  training  is 
meeting  AF  contracting  personnel  needs. 
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III.  Methodology 


Chapter  Overview 

This  chapter  discusses  and  reviews  the  particular  methodology  issues  relevant  to 
this  research  study  The  data  collection  plan  and  analyses  help  to  provide  the  data 
needed  to  determine  the  extent  to  which  the  training,  as  outlined  in  DOD  5000. 52M, 
meets  the  needs  of  AT  contracting  personnel  in  support  of  providing  a  mission  ready 
professional  work  force.  This  chapter  will  examine  the  research  method,  methodology 
literature,  population  and  sample,  instrument  development  and  testing,  and  the  data 
collection  plan. 

Method 

The  research  was  accomplished  by  a  formal  method  based  on  1 )  the  literature 
review,  2)  consultations  with  key  personnel,  and  3)  a  survey.  Through  the  collection  of 
primary  data,  the  investigative  questions  as  outlined  in  Chapter  1  were  examined  A 
survey  was  chosen  as  the  proper  instrument  for  data  collection  because  it  was  more 
versatile,  economical,  and  efficient  when  compared  to  observation  Additionally  by 
utilizing  a  survey  to  collect  the  data,  it  allowed  for  1 )  exact  selection  of  well-worded 
questions  geared  to  specific  data  collection,  and  2)  better  geographic  coverage  to  reach 
the  target  samples  (Emory  and  Cooper,  1991 :  31 8). 

Population  and  Sample 

The  steps  in  sampling  design  were  followed  in  order  to  determine  the  appropriate 
sample  for  this  research  study.  Based  on  Emory  and  Cooper,  the  following  sampling 
design  issues  were  addressed: 


What  was  the  relevant  population?  The  problem  statement  was  specific  to 
one  branch  of  military  service,  the  AF.  Further,  it  was  geared  to  a 
particular  career  field,  contracting  As  such,  the  relevant  population  was 
all  AF  contracting  personnel. 

What  were  the  parameters  of  interest?  The  problem  statement  was 
specific  to  the  issue  of  training  within  the  program  outlined  in  DOD 
5000. 52M,  therefore  training  was  a  parameter  of  interest.  Since  proper 
training  was  one  element  which  enabled  a  certification  level  to  be  attained 
under  the  program  as  outlined  in  DOD  5000. 52M,  the  certification  level 
was  also  a  parameter  of  interest. 

What  was  the  sampling  frame7  Based  on  the  population  and  the 
parameters  of  interest,  a  representative  sample  of  AF  contracting 
personnel  was  used.  To  accomplish  this  objective,  we  sampled  the 
following  1994  Professional  Continuing  Education  (PCE)  Courses. 


DAL  Course  Number 

Title 

Level 

CON  101/102 

Systems/ Base  Level  Contracting 

1 

CON  104 

Principles  of  Contract  Pricing 

I 

CON  105 

Operational  Level  Contract  Pricing 

I 

CON  201 

Government  Contract  Law 

II 

CON  221 

Intermediate  Contract 

Administration 

II 

CON  222 

Operational  Level  Contract 
Administration 

11 

1ND  101 

Contract  Property  Administration 

11 

IND  103 

Intermediate  Contract  Property 
Administration 

11 

CON  30 1 

Executive  Contracting 

III 

These  courses,  and  subsequently  the  personnel  attending  these  courses,  were  targeted  as 
the  sampling  frame  due  to  the  designation  of  DOD  certification  levels,  as  indicated 
above.  The  personnel  attending  the  courses  were  reflective  of  the  certification  level.  This 
assumption  allowed  the  researchers  to  better  estimate  the  potential  of  attaining  a 
representative  sample  of  the  population 

What  was  ihe  type  of  sample  to  be  employed?  Because  of  the  sample  and 
parameter  constraints  and  the  ability  to  maximize  response  and  minimize 
costs,  a  convenience  sample  of  PCE  students  was  used  (  Emory  and 
Cooper,  1991:274). 


What  was  the  size  of  the  sample  needed?  As  Kiejcie  and  Morgan  note,  the 
following  formula  was  used  to  determine  the  sample  size  for  each  sample 
field  (Isaac  and  Michael,  1990:  192): 

n  Nz2  *  .25  n  =  373.5 1 

(d2  *  [N-l]  +  (2  *.25) 

373.51-  6993  (T96)(1.96)*.25  ' 

(,05)(.05)*(6993-l  )+(2*.25) 

where  n  =  Sample  Population 
N  =  Population 
z  -Z  Score 
d  -  Chance  for  Error 

499  personnel  were  surveyed  to  ensure  that  at  least  n  or  374  personnel 
returned  the  surveys,  because  of  the  calculations  resulting  from  the 
formula  above  and  the  expectation  of  a  75%  response  rate. 

How  much  did  it  cost  to  employ'*  To  hoid  down  survey  costs,  the  survey 
was  administered  to  PCF.  students  attending  courses  at  Wright-Patterson 
AFB,  OH  Lackland  AFB,  TX;  and  off-site  courses  sponsored  by  the  PCE 
school  at  Wright-Patterson  AFB,  OH. 

Three  distinct  levels  of  workers  were  targeted  for  this  research  study  -  level  I, 
level  11,  and  level  III  personnel  -  in  order  to  be  reflective  of  the  three  levels  of 
certification  within  DOD  and  APDP.  These  levels  were  established  as  a  process  by 
which  personnel  could  progress  through  standards  of  experience,  training,  and  education 
-  level  1  (basic),  ievel  11  (intermediate),  and  level  111  (advanced).  Due  to  DOD  data  base 
limitations  in  constructing  numbers  for  the  relevant  population,  those  personnel  who  did 
not  hold  a  certification  level  were  classified  as  seeking  a  level  1  certification  or 
equivalent  to  level  1  personnel. 

The  sample  populations  were  constructed  in  order  to  reflect  i )  three  different 
views  of  thought  on  the  variables  of  interest  due  to  certification  level,  and/or  2)  similar 
attitudes  and  perceptions  concerning  the  variables  of  interest  Stratified  sampling 
improved  statistical  efficiency,  facilitated  the  data  gathering  to  ensuie  the  data  was 
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sufficient  to  analyze  the  sub-populations,  and  allowed  the  option  to  use  different  research 
methods  within  the  different  strata  (Emory  and  Cooper,  1991 :  266). 

Instrument  Development 

The  survey  was  used  to  collect  primary  data.  The  use  of  a  survey  was  determined 
through  a  review  of  the  advantages  and  disadvantages  of  various  data  collection 
instruments  (Emory  and  Cooper,  1991:  338).  One  survey  targeted  the  entire  sample. 
Surveys  provided  an  instrument  with  lower  costs  than  personal  interviews,  greater  reach 
of  a  dispersed  sample,  ease  of  contact  of  busy  and  mobile  personnel,  more  reflection  time 
for  the  respondent,  and  higher  anonymity  for  the  respondent.  The  disadvantages  of 
utilizing  surveys  were  non-response  to  the  survey  and  limited  information  gathering. 

The  use  of  a  convenience  sample  combated  these  disadvantages  in  that  the  ability  to 
reach  and  motivate  personnel  was  more  likely. 

The  instrument  response  structure  was  structured  with  both  open-ended  and 
close-ended  questions  The  use  of  a  five  point  Likert  scale  for  close  ended  questioning 
was  a  simple,  common  format,  requiring  less  time  for  the  respondent  to  select  a  response, 
allowing  for  correct  range  of  application,  and  was  a  method  compared  favorably  with 
other  data  collection  methods  (Emory  and  Cooper,  1991 :  209).  To  seek  the  opinions  and 
perceptions  within  the  survey  instruments,  open-ended  questions  were  employed. 
Throughout  the  instrument  development,  continual  evaluation  of  the  schedule  design, 
question  context,  question  wording,  response  structure,  and  question  sequence  occurred 
to  ensure  quality  and  quantity  responses  (  Emory  and  Cooper,  1991 .  1 35) 

Testing 

The  instrument  was  tested  to  identify  problems  prior  to  data  collection  (Emory 
and  Cooper,  1991 :  1 79)  There  were  two  pretest  groups  associated  with  the  instrument 
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testing.  One  test  group  consisted  of  the  AFIT  contracting  graduate  class.  The  second  test 
group  consisted  of  one  randomly  chosen  PCF.  class.  These  two  test  groups  allowed  the 
content  validity  to  be  examined  through  analysis  of  1 )  question  wording,  2)  shared 
vocabulary',  3)  question  clarity,  4)  assumptions,  5)  biased  wording,  and  6) 
personalization  (Emory  and  Cooper,  199 1 :36 1 ).  Pretest  findings  were  corrected  and/or 
incorporated  into  the  instrument.  Findings  from  the  pretests  included: 

1 .  Numbering  scheme  off 

2.  Likert  scale  categories  hard  to  distinguish 

3.  Basic  format  suggestions 

4.  Spelling  and  typographical  errors 

Data  Collection  Plan 

The  data  collection  plan  was  developed  to  foster  ease  of  implementation  and 
accuracy  in  collection  of  data.  Recording  sheets  for  the  surveys  consisted  of  Automatic 
Data  Processing  (ADP),  AFIT  Data  Collection  Form  1 1 E  which  facilitated  the  full  range 
of  responses  to  the  survey.  Data  was  collated  and  interpreted  based  on  the  computer 
collation  and  interpretation  of  ihc  data  by  the  statistical  program.  Elementary'  Statistical 
Analysis  System  (SAS).  These  results  were  randomly  checked  to  ensure  control  over  the 
procedure.  The  five  open-ended  questions  were  collated  by  hand  by  the  researchers 

Validity  was  examined  to  determine  if  the  data  were  relevant  to  the  proper 
measures  and  won*  free  from  bias  through  the  examination  of  normality  plots  and  alpha 
correlations.  This  was  performed  at  p  =  .000 1 ,  where  p  is  equal  to  chance  for  error. 

Plan  of  Av  sK'sis 

Frequency  tabulations,  summary  statistics,  and  correlational  analysis  were  utilized 
to  evaluate  the  majority  of  the  close-ended  questions.  Close-ended  questions  43  through 
200  used  Pearson's  correlational  analysis  to  determine  the  correlation  between 


competency  importance  and  proficiency.  To  identify  those  competencies  which  required 
further  analysis,  competencies  were  examined  for  an  increasing  upward  trend  in  the 
correlational  varies  from  level  1  personnel  to  level  111  personnel  The  research  team 
assumed  that  ti  ere  was  a  correlation  between  importance  and  proficiency  Therefore,  as 
the  certification  level  of  personnel  increased,  the  correlational  values  were  expected  to 
increase,  or  at  least  remain  equal.  An  r  less  than  or  equal  to  .39  (where  r  =  correlation), 
with  a p  greater  than  or  equal  to  .05  (where  p  =  chance  for  error),  were  used  as  the  values 
for  determining  competency  importance  and  proficiency  not  to  be  correlated.  All  open- 
ended  questions  were  categorized  and  ranked  according  to  open-ended  coding  (Emory 
and  Cooper  1991  457).  A  listing  of  the  competencies  and  their  correlations  appears  m 
Appendix  E.  Response  categories  for  open  ended  questions  one,  two,  and  four  included 
1 )  certification  program,  2)  training,  3)  education,  and  4)  experience.  Response 
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beneficial  class.  Sub-categories  were  also  used,  as  well  as  an  "other"  category  to  ensure 
exhaustive  coding  procedures  were  in  place.  Because  some  comments  included  a 
number  of  responses  answering  many  of  the  questions  at  once,  the  comments  were 
broken  apart  into  the  various  categories.  A  single  comment  may  have  been  sorted  into 
mat  y  categories,  based  on  the  subject  matter.  A  listing  of  the  response  categories 
appears  with  the  open-ended  answers  in  Appendix  E. 

Due  to  the  qualitative  nature  of  the  data  collected,  the  data  was  categorized  and 
displayed  in  tables  and  graphs.  The  presentation  of  the  data  was  driven  by  the  moderating 
variables  -the  demographic  items  on  the  survey  From  these  displays,  a  summary'  of  the 
data  facilitated  a  review  for  patterns  in  the  data.  Potential  improvements  in  training  as 
seen  by  the  different  levels  of  personnel,  as  well  as  the  overall  sample  population,  were 
identified. 
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Summary 

The  research  was  conducted  through  a  formal  method  of  collection  of  primary 
data.  The  design  utilized  a  survey  instrument  to  target  three  different  worker  levels  of 
the  sample  field  -  level  I,  level  II,  and  level  III.  To  accomplish  this,  surveys  were 
utilized  and  pretested.  Because  of  the  stratified  nature  of  the  data,  it  was  analyzed  and 
displayed  in  table  and  graphical  formats.  The  results  and  analysis  of  the  data  will  be 
discussed  in  Chapter  4. 
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IV.  Data  Collection  and  Analysis 


Chapter  Overview 

The  data  analysis  is  provided  in  this  chapter.  The  research  results  will  be 
presented  in  three  sections  -  survey  response,  demographics,  and  investigative  questions. 
Various  methods  were  used  to  generate  the  data  and  consisted  of  frequency  tabulations, 
summary  statistical  analysis,  and  correlation  analysis.  The  response  rate  to  the  various 
questions  in  the  instrument  varied.  All  numbers  reflected  throughout  this  section  are 
based  on  the  total  number  of  responses  to  a  particular  question  in  the  instrument.  The 
survey  instrument  as  presented  to  the  participants  appears  ai  Appendix  A. 

Survey  Response 

The  relevant  sample  was  based  on  the  6993  Air  Force  contracting  personnel  in  the 
population.  The  sample  population  was  determined  to  be  374  personnel.  499  su- veys 
were  distributed  and  333  were  completed  and  returned.  Surveys  were  reviewed  for 
missing  data.  Thirteen  were  not  included  in  the  data  base  because  of  missing  data.  Not 
all  surveys  included  in  the  data  base  contained  complete  information,  but  every  effort 
was  made  to  use  as  much  data  as  possible.  Surveys  were  discarded  because  the 
respondents  1 )  incorrectly  coded  the  survey  sheet  and  corrections  were  not  possible,  or  2) 
failed  to  answer  the  survey  instrument  beyond  the  demographic  questions.  The  final  data 
base  for  this  analysis  was  generated  from  320  surveys.  A  response  rate  of  64  1  %  was 
attained 
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Demographics 


The  demographic  section  of  the  survey  consisted  of  ten  questions.  These 
questions  identified  key  distinguishing  parameters  of  the  sample  The  question  areas  are 
noted  below.  Detailed  demographic  data  is  listed  in  Appendix  C. 

1 .  Rank/Grade  or  Series  -  Officer 

2.  Rank/Grade  or  Series  -  Enlisted 

3.  Rank/Grade  or  Series  -  Civilian 

4.  Education  Level 

5.  Experience  Level 

6.  Supervisory  Experience 

7.  Executive/Management  Experience 
8  Present  Job  Title 

d.  Contracting  Certification 
10.  Type  of  Contracting  f  unction  Assigned  To 


The  over  sampling  and  under  sampling  which  are  prevalent  in  the  sample 
statistics  were  difficult  to  control.  The  demographic  make-up  of  the  individuals 
participating  in  the  survey  through  selected  training  classes  was  anticipated  to  be 
representative  of  the  population.  Courses  were  chosen  to  be  sampled  based  on  the 
certification  level  rating  given  to  the  course,  for  example.  Advanced  Contract 
Administration  is  rated  as  a  level  11  course.  This  assumption  affected  the  final  sample 
statistics  because  not  ail  personnel  in  typical  level  1, 11,  and  111  courses  were  certified  at 
that  particular  level.  Further,  the  researchers  could  not  identify  the  mix  of  officer, 
enlisted  or  civilian  personnel  that  would  be  attending  a  given  training  course.  As  such, 
some  over  sampling  and  under  sampling  occurred  for  certain  portions  of  the  sample 
population. 
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Survey  Questions  1  -  3:  Rank/Grade  or  Scries  -  Officer,  Enlisted,  Civilian 


Table  4-1.  Population  and  Sample  Statistics  by  Officer,  Enlisted,  and  Civilian 


Population 

Sample 

#  of  Personnel 

Percentage 

#  of  Personnel 

Difference 

Officer 

826 

11.8% 

67 

9.1% 

Enlisted 

1339 

19.1% 

77 

24.1% 

5.0%  ! 

Civilian 

4828 

69.0% 

176 

55.0% 

-’.4  0% 

Total 

6993 

100.0% 

320 

100.0% 

The  demographic  analysis  provided  many  statistics  about  the  sample.  Table  4-1 


compares  the  entire  population  make-up  to  the  sample  population  make-up.  The  civilian 
portion  of  the  sample  comprised  55.0°  o  of  the  respondents.  The  officer  and  enlisted 
sample  population  comprised  20.9%  and  24. 1%,  respectively  Comparing  these  sample 
population  figures  to  the  relevant  population  figures,  there  is  an  indication  that  the 
civilians  within  the  sample  population  were  under  sampled  (-14.0%).  However,  the 
officers  (+9.1%)  and  enlisted  (1-5 .0%)  were  over  sampled. 


Survey  Question  4:  Education  Level 

The  education  levels  of  the  sample  reflect  62.8%  of  the  respondents  held  a 
bachelor's  degree  or  higher.  While  no  Ph.D.'s  were  noted,  20.6%  of  the  respondents  held 
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requirement  for  24  semester  hours  of  business  education  or  a  bachelor's  degree  Only 
2.8%  of  the  respondents  had  no  college  education.  This  was  anticipated  because  of  new 
enlisted  people  entering  the  career  field  and  the  grandfathering  of  civilians  for  the 
educational  requirements  for  certification. 
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Survey  Questions  5  -7:  Contracting  ,  Supervisory,  and  Executive  Experience  Levels 
There  were  three  areas  of  experience  identified  for  evaluation:  contracting, 
supervisory,  and  executive  Civilian  respondents  held  the  largest  amount  of  contracting 
experience  of  five  years  or  greater  (45.6%).  Enlisted  respondents  held  the  least  amount 
of  contracting  experience  of  five  years  or  greater  ( 1 1 .9  %).  Those  respondents  having 
had  more  than  one  year  of  supervisory  expenence  were  43.4%.  1 1 .3%  of  the  sample 
population  indicated  they  had  some  executive  experience. 


Survey  Question  8:  Present  Job  Titie 

The  majority  of  the  respondents  (37.8%)  were  contract  specialists.  The  fewest 
jobs  held  by  the  respondents  were  represented  by  procurements  analysts  (4.4° o).  A 
number  of  respondents  (14.7%)  indicated  that  they  fell  into  the  other  category 


Survey  Question  9:  Contracting  Certification 

Individual  certification  levels  provided  a  different  statistical  perspective  about  the 
sample  population.  Table  4-2  provides  a  comparison  of  the  relevant  population  to  the 
sample  population  by  certification  level 


Table  4-2.  Population  and  Sample  Statistics  by  Certification  Levels 


Population 

Sample 

i 

ft  of  Personnel 

Percentage 

#  of  Personnel 

Difference 

Level  I 

2189 

31.3% 

138 

43.1% 

1 1.8% 

Level  II 

4147 

59.3% 

143 

44.7% 

-14.6% 

Level  III 

657 

9.4% 

39 

12.2% 

2.8% 

Total 

6993 

100.0% 

320 

100.0% 

The  level  II  portion  of  the  sample  comprised  44.7%  of  the  respondents.  The  level  1  and 


III  sample  population  consisted  of  43  1%  and  12.2%  of  the  respondents,  respectively. 
Comparing  these  sample  population  figures  to  the  relevant  population  figures,  there  is  an 
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indication  that  the  level  H’s  ofthe  sample  were  under  sampled  (-14.6%).  Level  i’s  and 
Ill's  were  over  sampled  by  + 1 1 .8%  and  +2.8%,  respectively. 


Survey  Question  10:  Type  of  Contracting  Function  Assigned  To 

The  majority  (52.8%)  of  the  contracting  functions  represented  were  made  up  of 
the  operational  or  base-level.  The  systems-levei  function  was  the  second  highest  group 
represented,  with  12.5%  of  the  respondents.  The  training  function  comprised  the 
smallest  group,  with  only  4. 1%  ofthe  respondents.  Because  ofthe  use  of  a  convenience 
sample,  the  research  team  had  no  control  over  the  make-up  ofthe  Professional 
Continuing  education  (PCL)  courses  surveyed.  Additionally,  the  Air  force  Training 
Center  at  Lackland  AFB,  TX  was  used  as  a  survey  distribution  point  These  factors  may 
explain  the  larger  number  of  operational-level  respondents 


Investigative  Questions 

The  investigative  questions  were  analyzed  based  on  the  individual  answers  to  a 
variety  of  questions  in  the  survey  instrument.  Appendix  B  provides  a  tabular 
representation  ofthe  survey  questions  which  were  used  to  answer  each  investigate  e 


question  The  training  component  ofthe  certification  program  was  the  focus  of  the 


investigative  questions.  As  such,  the  moderating  variables  used  to  facilitate  the  analysis 
ofthe  investigative  questions  were  certification  levels. 

Survey  questions  1 1  through  200,  with  the  exception  of  question  15,  used  a  five 
point  Likert  scale.  Five  open-ended  questions  w'ere  included  in  the  survey  addressing 
various  topics.  Four  ofthe  open-ended  questions  were  used  to  answer  the  investigative 
questions.  One  question  concerning  competencies  was  not  used  due  to  an  small  portion 
(<  5%)  ofthe  population  responding.  All  data  were  analyzed  according  to  the 
methodology  plan  outlined  in  Chapter  3. 
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The  remainder  of  this  section  will  present  the  analysis  of  the  data  for  each  of  the 
investigative  questions  guiding  this  research  study  Appendix  C  details  data  concerning 
survey  questions  1 1  through  42,  Appendix  D  details  data  concerning  survey  questions  43 
through  200,  and  Appendix  E  details  data  concerning  the  open-ended  questions. 

Investigative  Question  1:  To  what  extent  was  the  training  component  of  the  career 
development  program  sufficiently  meeting  the  current  needs  of  AF  contracting 
personnel? 

Survey  Questions  13, 15,  36  to  42,  Open  Ended  Questions  1,  2,  and  4 
Survey  questions  thirteen  and  fifteen  specifically  sought  to  determine  the 
sufficiency  of  the  training  requirements  in  ensuring  that  the  Air  Force  has  a  mission  ready 
contracting  work  force  that  can  provide  effective  customer  support.  Question  1 3 
determined  to  what  extent  respondents  believe  the  training  requirements  are  sufficient. 
57.2%  of  respondents  indicated  that  the  training  requirements  are  sufficient. 


i  m  Level  I  □  Level  fl  E  Level  III 


Experience  Education  Training 


I  Component 

I 

i _ _ _ _ _ _ _ 

Figure  4-1.  Certification  Requirements  -  Ranking  of  Importance 

When  the  respondents  were  asked  to  rank  the  three  components  in  question  15  - 
experience,  training,  and  education  -  56.9%  of  th*'  respondents  ranked  experience  the 
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most  important  component.  34.2%  of  the  respondents  ranked  education  the  most 
important  component  and  8.9%  ranked  training  the  most  important  component.  Figure 
4-1  displays  the  respondents'  ratings  of  the  relative  importance  of  the  three  components 
Survey  questions  36  through  42  were  used  to  target  different  aspects  of  training  to 
determine  if  particular  training  needs  are  being  met.  These  questions  used  a  five  point 
Likert  scale  from  strongly  disagree  to  strongly  agree.  A  summary  of  the  overall 
viewpoints  of  the  sample  for  each  of  the  questions  is  presented  in  Table  4-3. 


Table  4-3.  Overall  Ratings  -  Questions  36  to  42 


r 

No. 

Strongly 

Disagree 

Disagree 

Neutral 

Agree 

Strongly 

Agree 

36. 

The  current  training  program  is  intended  to  familiarize  me  with  vaiious  aspect  of  |j 
contracting.  j 

1.3% 

1.6% 

8.2% 

68.0% 

20.9% 

XI 
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0.6% 

5.4% 

17.9% 

57  2% 

1.8.9% 

38. 

The  current  training  program  is  specific  enough  to  help  me  perform  mv  current  job  | 

1.9% 

17.6% 

25.8% 

45.3% 

9.4% 

|39. 

I  usually  receive  training  when  l  need  it. 

18.6% 

26.4% 

16.4% 

7.6%  jj 

40. 

Mv  training  needs  are  berter  met  through  alternate  training  sources. 

5.4%  |  29.8% 

4 1 .0% 

1 8.7% 

5.1% 

41. 

Once  1  have  attended  a  training  course,  l  am  better  abie  to  perform  my  job  1 

0.9%  J  4.4% 

21.1% 

. 

57.6% 

16.0%  jj 

I~42. 

After  1  have  attended  a  training  course,  1  am  better  able  to  apply  the  material  ! 

presented.  I 

0.3%  |  6.3% 

55.0% 

W 

For  question  36,  88.9%  of  the  respondents  agreed  that  the  training  program  is 


intended  to  familiarize  them  with  various  aspects  of  contracting.  The  majority  of 
respondents  for  question  37  also  agreed  that  the  training  program  is  beneficial  to  their 
ability  to  perform  their  jobs  (76. 1%).  For  question  38,  54. 7%  of  the  respondents 
indicated  that  they  agreed  that  the  program  is  specific  enough  Question  39  presented  a 
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different  picture  with  45  0%  of  the  respondents  disagreeing  with  the  statement  that  they 
receive  training  when  they  need  it  and  only  38.7%  agreeing.  The  majority  of  the 
respondents  were  neutral  (41.0%)  for  question  40  concerning  meeting  training  needs 
through  alternate  training  sources.  73.6%  of  the  respondents  agreed  with  question  41 
concerning  ability  to  perform  after  training.  The  majority  of  the  respondents  (70  1%) 
agreed  with  question  42  about  increased  ability  to  apply  material. 

To  summarize,  the  majority  of  the  respondents  agreed  that  the  training  program  is 
i)  intended  to  familiarize;  2)  beneficial  to  job  performance;  and  3)  provides  specific 
enough  training.  Also,  the  majority  of  respondents  agreed  that  the  individual  training 
.ourses  better  enable  them  to  1 ;  perform  theirjobs,  and  2)  apply  the  matetial  presented  in 
the  courses.  It  is  noted  that  the  respondents  were  neutral  concerning  the  need  lor 
alternate  training  sources.  Finally,  the  larger  percentage  of  the  respondents  disagreed  that 
they  receive  training  when  they  need  it. 

Open-ended  questions  1,  2,  and  4  were  categorized  into  three  response  categories. 
Certification  Program  Satisfaction  and  Importance,  Certification  Program  Dissatisfaction 
and  Concerns,  and  Certification  Program  and  Established  Standards.  The  top  live 
categories  concerning  the  respondents  are  listed  in  Table  4-4. 


Table  4-4.  Top  Five  Categories  of  Comments  and/or  Concerns 


Ranking 

#  of  Responses* 

Category  of  Comment  and/or  Concern 

1 

28.3% 

Program  is  Perceived  as  Having  Value  or  Worth 

2 

17.6% 

Experience  Requirements  are  Too  Low 

2 

17.6% 

Training  Needs  and  Suggestions 

3 

15.1% 

Training  Applicability 

|  4 

13.8% 

Importance  of  Experience 

5 

13.2% 

Training  Availability' 

•IVtccntagCN  ;uc  calcul.tlcd  I'ruin  ,t  !>;ise  o|  I  ic^xiinlcnK 
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The  comments  and  concerns  parallel  the  findings  in  the  close-ended  questions.  The 
overall  program  was  perceived  as  valuable  and  meeting  respondents'  needs.  Experience 
was  noted  as  the  most  important  component  in  meeting  the  goals  of  APDP  Finally, 
comments  and  concerns  on  training  needs,  applicability,  and  availability  are  reflecliv  r 
the  responses  received  on  questions  36  through  42 


Investigative  Question  2:  To  what  degree  did  level  I,  level  II,  and  level  III  personnel 
believe  that  the  training  component  of  the  career  development  program  is 
sufficiently  meeting  the  current  needs  of  Air  Force  contracting  personnel? 

Survey  Questions  13, 15.  36  to  42 

The  same  survey  questions  used  to  answer  investigative  question  one  were  also 
used  to  answer  investigative  question  two.  Investigative  question  one  was  a  macro- 
viewpoint  of  the  training  component  sufficiency,  whereas  this  investigative  question  is 
the  micro-viewpoint  of  the  training  component  sufficiency  by  certification  levels  of 
respondents.  It  was  expected  that  training  needs  are  unique  for  each  level,  therefore  each 
survey  question  was  examined  at  the  different  levels.  Response  rates  reflected 
throughout  this  section  are  in  terms  of  the  percentage  of  respondents  within  the 
applicable  certification  level,  not  the  entire  sample  population. 


Table  4-5.  Sufficiency  of  Current  Training  Requirements  Within  Certification 
_ _  Levels 


Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

j  Level  1 

3.6% 

15.9% 

24.6% 

49.3% 

6.5% 

Level  II 

2.1% 

20.3% 

19.6% 

49.0% 

9.1% 

j  Level  Hi 

2.6% 

25.6% 

12.8% 

59.0% 

0.0% 

Table  4-5  indicates  the  viewpoints  of  the  personnel  do  change  based  upon 
certification  levels.  The  majority  of  level  I  (55.8%),  level  II  (57.8%)  and  level  111 


(59.0%)  respondents  agree  that  the  current  training  requirements  are  sufficient. 
However,  a  higher  percentage  of  level  III  respondents  (28.2%)  disagree  with  the 
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sufficiency  of  the  training  requirements,  compared  to  level  I  (19.6%)  and  level  II  (22.5%) 
respondents. 


Experience  Education  Training 

Component 

Figure  4-2.  Certification  Requirements  -  Ranking  of  Importance  Within  Levels 


Figure  4-2  indicates  that  certification  levels  of  personnel  also  provide  different 
viewpoints.  71.8%  of  Level  Ills  rated  the  experience  component  as  the  most  important, 
with  58.3%  of  level  IIs  rating  it  most  important,  and  51.5%  of  the  level  Is  rating  it  the 
most  important  component.  It  is  noted  that  the  importance  of  experience  increased  with 
each  progressive  certification  level.  The  respondents'  evaluation  fluctuates  between  the 
levels.  Level  II  respondents  rated  the  training  component  the  most  important  (10.8%), 
with  levels  tils  being  slightly  less  at  7.7%  and  level  Is  responding  at  6.7%.  The 
education  components  importance  decreased  with  each  progressive  certification  level. 
41.8%  of  level  I  respondents  rated  education  as  most  important,  while  level  IIs  responded 
at  30.9%  and  level  HIs  responded  at  20.5%. 

Questions  36  through  42  were  used  to  target  various  aspects  of  training  at  the 
different  certification  levels.  Each  question  was  examined  for  changing  perceptions 
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between  the  certification  levels.  This  evaluation  also  compares  the  level  analysis  to  the 
overall  sample  population  analysis  presented  for  investigative  question  one. 


Table  4-6.  Responses  to  Question  36  Within  Certification  Levels 


The  current  training  program  is  intended  to  familiarize  me  with  various  aspects  of  contracting. 

Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  1 

1.5% 

1.5% 

8.1% 

66.9% 

22.1% 

1  Level  II 

0.7% 

2.1% 

66.4% 

20.7% 

j  Level  III 

2.6% 

0.0% 

2.6% 

79.5% 

15.4% 

For  question  36,  all  three  levels  agreed  that  the  training  program  is  intended  to 


familiarize  them  with  contracting.  Level  1  (89.0%),  level  11  (87  1%),  and  level  ill 
(94.9%),  perceptions  were  close  to  the  rating  of  the  entire  sample  (88.9%). 

Table  4-7.  Responses  to  Question  37  Within  Certification  Levels 


The  current  training  program  is  beneficial  to  iny  ability  to  perform  my  current  job. 


Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  1 

5.8% 

15.2% 

59.4% 

19.0% 

Level  II 

0.7% 

5.0% 

2 1 .4% 

54.3% 

18.0% 

Level  111 

2.6% 

5.1% 

15.4% 

Question  37  found  consistent  responses  across  the  levels  agreeing  that  the  current 
training  is  beneficial.  Level  I  (79.0%),  level  II  (72.9%)  and  level  111  (76.9%)  agreed  that 
the  current  training  is  beneficial.  This  was  consistent  with  the  sample  population 
evaluation  of  76.1%. 

Table  4-8.  Responses  to  Question  38  Within  Certification  Levels 


The  current  training  program  is  specific  enough  to  help  me  perform  my  current  job 


Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  1 

1.4% 

15.9% 

29.7% 

44.2% 

8.7% 

Level  II 

2.1% 

19.3% 

23.6% 

10.0% 

Level  III 

2.6% 

17  9% 

_  . 

20.5% 

we* 

7. 7% 
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Question  38  also  found  that  the  three  ievels  were  close  in  agreement  concerning  if 
the  training  program  was  specific  enough  for  job  performance.  Level  1  (52.9%),  level  II 


(55.0%),  and  level  111  (59.0%)  paralleled  the  percentage  of  the  sample  (54.2%). 

Table  4-9.  Responses  to  Question  39  Within  Certification  Levels 


I  usually  receive  training  when  I  need  it. 


Disagree 

Neutral 

BSS 

Strongly  Agree 

j  Level  1 

21.0% 

27.5% 

21.0% 

24.6% 

5.8% 

jj  Level  11 

20.7% 

27.1% 

1 5.0% 

30.7% 

6.4% 

|  Level  III 

2.6% 

20.5% 

5.1% 

56.4% 

15.4% 

Question  39  found  some  dispersion  amongst  the  levels.  Level  1  (48.5%),  level  II 
(47.9%)  and  levei  II!  (23. !%)  disagreed  that  they  usually  receive  training  w  hen  ihe\  need 
it.  Level  1  and  11  figures  are  consistent  with  the  overall  sample  (45.0%).  However,  le\el 
III  figures  are  not.  The  majority  of  level  111  respondents  agreed  with  this  question 
(71.8%) 


Table  4-10.  Responses  to  Question  40  Within  Certification  l  evels 


My  training  needs  are  better  met  through  alternate  training  sources. 

Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  1 

4.4% 

26.8% 

44.2% 

2 1 .6% 

3.6% 

Level  II 

6.6% 

27.0% 

40.9% 

18.2% 

7.3% 

Level  III 

5.1% 

51.3% 

30.8% 

12.8% 

0.0%  | 

For  question  40,  level  1  and  11  respondents  within  each  level  were  neutral.  Level  ! 


(44.2%)  and  level  il  (40.9%)  held  consistent  with  the  sample  (45.0%),  whereas  level  III 
(30.8%)  respondents  were  not  as  neutral  concerning  question  40.  Level  Ills  disagreed 
(56.4%)  that  their  training  needs  are  better  met  through  alternate  sources. 
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Table  4-11.  Responses  to  Question  41  Within  Certification  Levels 


Once  I  have  attended  a  training  course.  1  am  better  able  to  perform  my  job.  j 

Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  1 

4.3% 

18.8% 

58.0% 

18.8% 

Level  11 

2.1% 

20.0% 

57.9% 

Crt 

o 

o 

o 

Level  111 

0.0% 

2  6% 

33.3% 

56.4% 

7.7% 

For  question  4L  level  III  (64.1%)  were  most  consistent  with  the  sample  (63.6%) 
in  agreeing  that  they  are  better  able  to  perform  their  job  after  they  have  attended  a  course. 
Level  1  (76.8%)  and  level  II  (72.9%)  had  stronger  figures  agreeing  with  question  41 .  The 
level  Ills  had  a  larger  number  of  respondents  who  were  neutral  on  this  question  (33.3%). 

Table  4-12.  Responses  to  Question  42  Within  Certification  Levels 


Alter  l  have  attended  a  training  course.  1  am  able  to  apply  the  material  presented. 


Strongly  Disagree 

Disagree 

Neutrai 

Agree 

Strongly  Agree 

Level  I 

r  0.0% 

5.8% 

22.5% 

53.6% 

18.1% 

Level  II 

_ 

0.7% 

6.4% 

20.7% 

57.9% 

14.3% 

j  Level  111 

0.0% 

7.7% 

5.1% 

Level  l  (71.7%)  and  level  II  (72.2%)  respondents  were  closest  in  agreement  to  the 
overall  sample  (70. 1%)  for  question  42  56.4%  of  the  level  111  respondents  agreed  with 
this  question,  however  a  large  number  of  the  level  Ills  (35.9%)  were  neutrai 


iPiVCStigrttiVc  Question  3;  VVuat  types  of  naming  COUTS6S  wtic  jiciCtriVed  iO  ut* 
adequate  and  consistent  with  personnel  needs  for  support  of  the  mission  and  the 
development  of  a  professional  work  force? 

Survey  Questions  16  to  35,  Onen-Ended  Question  3 
Respondents  evaluated  the  current  certification  training  courses  on  a  five  point 
Likert  scale  on  the  basis  of  strongly  disagree  to  strongly  agree.  Of  the  courses  evaluated, 
a  range  of  64.3%  to  100.0%  of  respondents  ranking  the  courses  as  adequate.  The 
rankings  of  the  top  five  courses  in  terms  of  adequately  meeting  the  respondents'  needs  are 
listed  below  in  Table  4-13. 
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Table  4-13-  Top  Five  Courses  Perceived  as  Most  Adequate 


Ranking* 

Certification  Training  Course  Title 

1 

Government  Contract  Law 

2 

MDAC  -  Basic 

3 

Principles  of  Cost  and  Pricing 

4 

MDAC  -Advanced 

5 

Defense  Cost  and  Price  Analysis/Negotiations 

•Rankings  arc  calculated  Irom  a  weighted  base  ol'  1 740  training  clas*c»  attended. 

Open  -ended  question  3  asked  respondents  to  identify  the  training  courses 
perceived  most  and  least  beneficial.  The  top  five  responses  for  the  training  courses 
perceived  as  most  beneficial  are  listed  in  Table  4-1 4. 

Table  4-14.  Top  Five  Training  Courses  Perceived  as  Most  Beneficial 


Ranking  #  of  Responses*  Training  Course 


28  0%  Government  Contract  Law 


MDAC  -  Basic. 


MDAC-  Advanced  jj 


Contract  Administration  -  Advanced 


12.2%  Principles  of  Contract  Pricmg 


5  6.1%  Base  Contract  Administration 


Percentages  are  calculated  Imm  a  Ixinc  «>1  S2  ievj)ondenis 

It  is  noted  that  similar  courses  are  found  in  each  of  the  top  five  listings  for  both  the  close- 
ended  and  open-ended  questions. 

Investigative  Question  4:  To  what  extent  is  the  individual's  perception  of  the 
importance  and/or  need  for  the  competency  in  job  performance  commensurate  with 
the  proficiency  level  at  which  the  individual  evaluates  his/her  proficiency? 

Survey  Questions  43-200 


Survey  questions  43  through  200  rated  79  units  of  instruction,  or  competencies. 
The  competencies  v/ere  evaluated  in  two  areas  1 )  the  importance  to  overall  job 
performance  and  2)  the  current  level  of  proficiency.  A  live  point  Likert  scale  was 
employed.  To  evaluate  how  much  the  importance  and  proficiency  factors  differed,  an 
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overall  ranking  of  the  importance  levels  was  compiled.  Graphs  and  supporting 
documentation  are  in  Appendix  D. 

The  top  10  competencies,  ranked  by  importance,  are  displayed  in  Table  4-15. 
The  bottom  1 0  competencies,  ranked  by  importance  are  displayed  in  Table  4-16. 


Table  4-15.  Top  Ten  Competencies  by  Importance 


|  Ranking 

Value 

11  nit  of  Instruction  (Competency)  ' 

I  1 

88.5% 

Contract  Modifications 

1  2 

87.8% 

Competition  Requirements 

3 

87.5% 

Statements  of  Work 

4 

85.7% 

Hthics/Standards  of  Conduct 

5 

85.3% 

Conducting  Negotiations 

6 

84. 8°  o 

Solicitation  Preparation  , 

7 

84  6% 

Specifications  j 

8 

83.1% 

Responsiveness 

1  9 

82.8% 

Negotiation  Strategy 

|  10 

82.6% 

Method  of  Procurement 

Tabic  4-16.  Bottom  Ten  Competencies  by  Importance 


Ranking 

Unit  of  Instruction  (Competency) 

1 

Letter  Contracts  ! 

2 

28.3% 

Lease  vs.  Purchase  1 

t 

3 

26.0% 

Need  for  Bonds 

4 

25.6% 

Unsolicited  Proposals 

5 

22.8% 

Forecasting  Requirements 

6 

21.7% 

Bonds 

7 

21.4% 

Collecting  Contractor  Debts 

8 

19.6% 

Market  Research 

9 

18.1% 

Contract  Financing 

|  10 

17.0% 

.  . . -  ...n— -J 

Accounting  and  Estimating  Systems 

Correlation  analysis  was  performed  on  the  79  competencies  to  determine  the 


degree  of  correlation  between  the  individual's  perception  of  the  competency's  importance 
and  the  individual's  proficiency  level.  An  examination  for  upward  trends  in  the 
correlation  values  for  each  of  the  certification  levels  was  then  performed  An  upward 
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trend  was  anticipated  by  the  research  team  because,  for  each  certification  level,  as  the 
importance  of  competency  rises,  so  should  the  proficiency  level.  Therefore,  the  gap 
between  importance  and  proficiency  should  collapse  or  close  as  personnel  progress  from 
level  I  through  level  Ill.  18  competencies  which  did  not  reflect  an  upward  trend  are 
listed  in  Table  4-1 7.  Competencies  with  p  >.05  and/or  r<  or  =  to  .39  were  determined 
not  to  be  correlated.  Correlations  in  bold  represent  those  competencies  that  are  not 
correlated.  Competencies  which  are  not  correlated  provide  that  respondents  perceive  a 
large  difference  between  the  perceived  importance  of  the  competency  and  their  perceived 
proficiency  for  that  competency.  Appendix  D  includes  the  listing  of  other  competencies 
which  arc  not  correlated  based  on  the  stated  p  and  r  values. 


Table  4-17.  Competencies  Without  Upward  Trend  From  Level  1  to  Level  III 

Level  III 


Unit  of  Instruction  (Competency) 


Level  1 


Level  11 


Acquisition  Planning 


u.i* 


0. 


-<  n 
,  io 


Market  Research 


0.50 


Statements  of  Work 


0.44 


0.48 


0.40 


0.45 


0.59 


Services  Contracting  Issues 


0.53 


0.71 


0.47 


Set-Asides 


0.33 


0.51 


0.40 


8(a)Procurements 


0.35 


Technical  Evaluation  Factors 


0.28 


0.51 


0.48 


0.32 


0.30 


Procurement/Source  Selection  Plans 


0.33 


Antrnnt  T\'rv» 

JtlCVtlUil  \J  t  'wUllUUVI  l  T  pw 


ft 


0.59 


0  54 


0.31 


0,37 


Processing  Bids 


0.43 


0.61 


0.53 


Late  Bids 


0.43 


0.59 


0.41 


Bid  Prices 


0.45 


0.61 


0.46 


Responsiveness 


0.43 


0.63 


0.59 


Cost  and  Pricing  Data 


0.28 


0.44 


0.34 


Audits 


0.09 


0.42 


0.37 


Property 


0.35 


0.46 


0.39 


Collecting  Contractor  Debts 


0,10 


0.45 


0  39 


Progress/Advance  Payments 


0.42 


0.39 


0.59 
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Summary 

This  chapter  has  provided  the  results  of  this  research  effort  in  support  of 
determining  the  sufficiency  of  professional  training  of  AF  contracting  personnel  The 
data  reflects  that  some  discrepancies  do  exist  in  how  AF  contracting  personnel  perceive 
the  certification  program,  particularly  the  training  component.  Chapter  5  will  provide 
the  conclusions  and  recommendations  pertaining  to  these  areas. 
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V.  Conclusions  and  Recommendations 


Chapter  Overview 

The  following  section  provides  the  conclusions  and  recommendations  drawn  from 
this  effort,  study  limitations,  and  suggestions  for  further  study.  As  the  DOD  continues  to 
downsize,  more  and  more  emphasis  has  been  placed  on  getting  the  most  from  every 
dollar  committed  in  the  acquisition  arena.  The  current  career  development  program 
strives  to  establish  an  elite  group  of  career  professionals  who  are  capable  of  satisfying  the 
mission  with  the  most  effective  and  efficient  use  of  resources  Training  is  \  ital  to  the 
success  of  this  program.  This  research  effort  has  provided  the  perceptions,  attitudes,  and 
beliefs  of  the  Air  Force  contracting  work  force  concerning  the  current  training  and  how 
sufficiently  it  is  ensuring  that  the  Air  Force  has  a  mission  ready  professional  contracting 
work  force. 

Conclusions  and  Recommendations 

Investigative  Question  1.  To  what  extent  was  the  training  component  of  the  career 
development  program  sufficiently  meeting  the  current  needs  of  AF  contracting 
personnel? 

Conclusion  1.  Even  though  the  training  requirements  were  viewed  as  sufficiently 
ensuring  that  the  Air  Force  has  a  mission  ready  professional  contracting  work  force  bv 
slightly  more  than  half  of  the  respondents,  they  were  ranked  as  the  most  important 
component  by  the  fewest  number  of  respondents.  This  indicates  that  while  over  half  of 
the  respondents  viewed  the  training  requirements  as  sufficient,  training  is  not  viewed  as 
the  most  important  component  to  ensuring  the  AF  has  a  mission  ready  professional 
contracting  work  force 
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Experience  was  ranked  as  the  most  important  component  by  more  than  half  of  the 
respondents.  However,  less  than  half  of  the  respondents  perceived  experience  as 
sufficient.  This  indicates  that  the  respondents  perceive  experience  as  the  most  important 
component  to  ensuring  the  AF  has  a  mission  ready  professional  contracting  work  force, 
but  do  not  believe  that  the  experience  requirements  are  sufficient 

Recommendation.  Increase  Experience  Requirements.  An  individual  can  now 
progress  to  a  level  III  certification  in  half  the  time  of  the  past  AF  program  requirements. 
This  could  be  detrimental  to  the  contracting  career  field  which  relies  on  the  experience 
quotient  for  job  performance.  In  addition,  a  person  progresses  through  the  training 
courses  at  a  more  rapid  pace.  This  may  severely  impact  the  iraining  program's 
applicability,  availability,  and  timeliness 

Conclusion  2.  Respondents  indicated  strong  agreement  concerning  the  role  of 
the  training  program  to  familiarize  them  with  various  aspects  of  contracting.  There  was 
also  a  strong  percentage  of  agreement  indicating  that  the  training  is  beneficial  to  job 
performance  and  ability  to  apply  material  presented  in  the  courses.  However, 
respondents  indicate  a  need  for  instruction  beyond  familiarization  because  only  half  of 
the  respondents  noted  that  the  training  is  specific  enough.  This  implies  that  while  the 
courses  are  being  taught  at  a  familiarization  level,  more  specific  topics  are  needed.  If 
more  specific  topics  were  incorporated  into  the  courses,  job  performance  and  ability  to 
apply  the  material  could  be  expected  to  increase.  However,  this  is  only  true  if  the  person 
uses  this  topic  for  job  perfromance. 

Almost  half  of  the  respondents  indicated  that  they  do  not  receive  training  when 
they  need  it.  However,  over  one-third  agreed  that  they  do  receive  it  when  they  need  it 
This  indicates  a  need  to  establish  a  better  way  to  monitor  progression  throughout  the 
program  and  ensure  that  the  courses  arc  1 )  available,  2)  taken  at  the  right  time  for  career 
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progression  and  3)  targeting  the  appropnate  audiences  based  on  applicable  functions  ( i.e. 
base-level  versus  systems-level). 

Recommendations. 

1.  Focus  Courses  to  Better  Meet  Needs  of  Personnel.  Incorporate  more 
specific  topics  into  the  current  course  structures.  Utilize  some  of  the  training  suggestions 
and  topics  identified  in  this  study  to  begin  to  isolate  potential  areas  for  inclusion  into  the 
courses.  Additionally,  ensure  that  courses  are  targeting  a  well-rounded  audience  with 
specific  functional  contracting  concerns. 

2.  Develop  Formal  On-the-job-Training  (OJT)  Programs.  Specificity 
and  applicability  of  training  has  been  identified  as  a  key  area  for  concern  within  the 
training  program.  As  such,  a  more  formalized  OJT  program  should  be  developed.  OJT 
programs  can  be  tailored  to  the  more  specific  needs  at  the  unit.  It  will  help  ensure  that 
the  work  force  has  a  demonstration  phase  for  the  skills  and  knowledge  which  they  have 
learned  from  the  Professional  Continuing  Education  (PCE)  courses  This  program  could 
be  easily  tailored  to  meet  individual  needs  in  training  topics,  progression  rate,  etc. 

3.  Establish  Career  Development  Progression  Management 
Information  System  (MIS).  Determine  and  establish  an  on-iine  system  which  provides 

1 1  recommended  lime  frames  for  nroPTession  throughout  traminu  nrmmim  1  nroecs  tor 

*  ’  "  I  'U  - C7 - - - "'Q  I - 5" - r  —  / - - 

training  monitors  to  input  actual  needs  for  training  slots,  and  3)  capability  of  training 
monitors  to  monitor  each  individual's  career  plan.  To  augment  this  MIS,  establish  a 
model  career  plan  to  provide  an  example  for  ideal  career  progression  for  the  contracting 
work  force. 


Investigative  Question  2.  To  what  degree  did  ievel  I,  level  II,  and  level  HI  personnel 
believe  that  the  training  component  of  the  career  development  program  is 
sufficiently  meeting  the  current  needs  of  AF  contracting  personnel? 

Conclusion  1.  As  the  certification  level  increased,  the  training  requirements  were 
ranked  as  sufficient  with  small  increasing  percentages  of  respondents  from  level  1  to  level 
111.  The  ranking  of  the  importance  of  the  training  component  was  the  lowest  of  the  three 
components  for  all  certification  levels.  The  viewpoints  ot  the  level  1  to  III  respondents 
are  consistent  with  the  overall  population. 

The  experience  requirement  has  a  decreasing  rating  of  sufficiency  from  level  I  to 
III.  The  largest  difference  in  perception  of  the  experience  requirements  was  noted  from 
the  level  il  to  the  level  III  perspective.  The  majority  of  level  Ill's  disagreed  that  the 
experience  requirements  are  adequate.  In  addition,  the  importance  of  the  experience 
component  increased  from  level  I  to  111.  These  findings  were  consistent  with  the  sample 
population  in  indicating  that  while  the  experience  component  is  the  most  important,  it  is 
not  sufficient.  Level  Ill's  hold  the  strongest  perception  ol  the  discrepancy  between 
sufficiency  and  importance  of  the  experience  component 

Conclusion  2.  Level  III  respondents  consistently  held  the  most  different 
perceptions  concerning  training,  f  irst,  the  majority  of  level  Ill's  agreed  that  they  receive 
training  when  they  need  it.  T  his  was  not  true  with  level  fs  and  li's.  Additionally,  over 
half  of  level  Ill's  disagreed  that  their  training  needs  are  better  met  through  alternate 
sources.  The  majority  of  level  I's  and  H's  were  neutral.  Level  111  respondents  were  also 
lowest  in  agreement  that  after  training  1 )  they  are  better  able  to  perform  their  jobs  and  2) 
are  able  to  apply  the  material.  However,  level  Ill’s  were  also  the  group  with  the  most 
respondents  agreeing  that  the  program  is  specific  enough. 

Recommendation.  Basic,  Intermediate,  and  Advanced  Courses.  Although 
some  course  structures  already  exist  in  this  formal,  courses  should  be  tailored  to  the  three 
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level?  to  meet  the  progression  of  needs  of  the  individual.  Course  structure  should  be 
guided  by  the  needs  identified  by  the  respondents  in  the  survey  concerning  specificity, 
applicability,  timeliness,  etc. 

Investigative  Question  3.  What  types  of  training  courses  were  perceived  to  be 
adequate  and  consistent  with  personnel  needs  for  support  of  the  mission  and  the 
development  of  a  professional  work  force? 

Conclusion.  The  various  training  courses  were  rated  well  -  with  a  range  of 
64.3%  to  100.0%  -  indicating  that  the  courses  are  perceived  as  overall  adequate.  The 
level  I  and  11  courses  wore  consistently.  rated  the  highest  in  adequacy  Level  111  courses 
did  not  get  a  high  number  of  adequate  ratings.  This  is  eonsistent  with  the  viewpoints  of 
level  Ill's  on  training,  since  level  Ill's  identified  the  most  inconsistencies  with  training. 
Ratings  indicate  that  all  courses  are  perceived  to  provide  benefit  to  the  individual  and  the 
program.  The  courses  rated  most  beneficial  paralleled  the  courses  rated  most  adequate. 
Comments  indicate  that  the  number  one  reason  why  the  courses  were  perceived  as  most 
beneficial  was  the  courses'  applicability  to  the  job. 

Recommendation.  Evaluate  Level  III  Courses.  The  level  111  courses  were  not 
ranked  as  inadequate,  however,  none  of  the  courses  were  ranked  in  the  top  five  of  the 
courses  perceived  as  the  most  beneficial  Additionally,  the  le'd  III  respondents 
indicated  a  problem  might  exist  within  the  training  courses  in  that  the  level  Ilfs  did  not 
perceive  certain  aspects  of  the  training  program  similar  to  level  I  and  II  respondents.  As 
such,  a  review  of  the  currency  and  applicability  of  the  level  III  courses  should  be 
performed. 
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Investigative  Question  4.  To  what  extent  is  the  individual's  perception  of  the 
importance  and/or  need  for  the  competency  in  job  performance  commensurate  with 
the  proficiency  !evel  at  which  the  individual  evaluates  his/her  proficiency? 


Conclusion.  Differences  in  perceptions  of  competency  importance  and 
competency  proficiency  exist.  Of  the  competencies  rated  the  most  and  least  important,  a 
range  of  38.9.%  to  88.5%  was  noted.  Only  five  competencies  were  rated  with  less  than  a 
50.0%  importance  rating. 

Certain  competencies  are  identified  for  potential  review  based  on  two  types  of 
analysis  1 )  trend  analysis  and  2)correlational  analysis.  1 8  competencies  were  identified 
on  the  basis  that  they  did  not  display  the  expected  upward  trend  for  correlational  values 
from  level  I  to  level  111.  Various  competencies  were  identified  lor  each  certification 
level  on  the  basis  that  the  correlational  values  indicated  that  the  competency  importance 
and  proficiency  were  not  correlated.  This  listing  can  be  viewed  in  Appendix  D 
Recommendations. 


1.  Establish  Comprehensive  and  Continuous  Review  of  Competencies. 

Respond  to  the  need  for  further  evaluation  of  those  competencies  identified  in  tins  studv. 
Currency  of  topics  is  vital  to  meeting  the  challenges  of  the  defense  acquisition  system  of 
tomorrow.  Therefore,  establish  a  permanent  board  to  review  the  topics  quarterly.  Within 
inis  uoaiu,  esiaousii  u  uircei  iuic  ii'oiVi  tlic  unit  (i.e.  training  monitors,  squadron 
commanders,  deputies,  etc.)  to  be  able  to  pursue  a  total  quality  management  bottom-up 
review  approach  and  funnel  suggestions  for  potential  units  of  instruction. 

2,  Validate  Needed  Proficiency  Levels.  While  this  study  only  sought  to 
identify  competencies  for  further  review,  there  is  a  need  to  establish  some  sort  of 
proficiency  baseline  -  how  proficient  must  the  individual  realistically  be  to  perform 
within  the  established  level.  The  goals  for  the  proficiency  levels  which  arc  established 
for  the  courses  may  or  may  not  be  attainable  within  euirent  training  program. 


Study  Limitations 

Various  study  limitations  were  noted  in  this  research  effort.  Most  of  the 
limitations  were  recognized  prior  to  conducting  the  research. 

First,  a  convenience  sample  was  employed  The  distribution  of  personnel 
attending  the  PCE  courses  was  expected  to  produce  a  distribution  of  personnel  similar  to 
the  relevant  population.  Because  the  attendance  was  predetermined,  the  demographic 
make-up  of  the  courses  was  difficult  to  control  The  survey  statistics  presented  in 
Chapter  4  indicate  this  caused  the  civilian  and  level  II  sample  population  to  be  under 
sampled. 

Next,  the  individuals  attending  the  courses  may  or  may  not  have  been  the  most 
appropriate  to  survey,  since  participants  were  receiving  training  and  therefore  more 
acutely  aware  of  their  ideas  and  perceptions  on  training.  This  limitation  may  apply  more 
to  the  new  personnel  of  the  contracting  work  force  -  since  their  knowledge  base 
concerning  the  contracting  career  field  and  the  career  development  program  may  be 
limited.  However,  perceptions  of  the  entry-level  respondents  could  not  be  ignored 
because  a  training  program  must  target  all  personnel  -  from  those  having  no  experience 
to  those  having  extensive  experience. 

A  third  limitation  was  that  the  survev  instrument  was  leneiliv  As  a  rcsull  some 
interest  may  have  been  lost  for  those  items  toward  the  end  of  the  survey  instrument.  This 
may  have  caused  some  leveling  of  answers  by  respondents. 

Another  limitation  to  this  study  was  that  the  participants  were  limited  to  AF 
contracting  personnel.  Although  DOD  career  program  requirements  are  standardized, 
some  service-unique  philosophies  may  be  prevalent  which  this  effort  cannot  identify. 

The  final  study  limitation  was  a  self-rating  problem  for  survey  questions  43 
through  200.  Respondents  were  asked  to  rate  how  important  and  how  proficient  they 
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were  for  certain  competencies.  The  potential  for  over-inflated  ratings  for  each  individual 

* 

was  high,  since  human  nature  is  to  inflate  self-ratings. 

Suggestions  for  Further  Study 

Many  potential  areas  for  future  research  were  identified.  This  research  was  the 
first  in  the  career  development  program  arena  and  has  spawned  numerous  areas  for 
further  review. 

Administer  Survey  Instrument  to  Contracting  Policy-Making  Personnel. 
Administering  the  current  survey  instrument  to  policy  making  personnel  would  provide  a 
basis  for  comparison  between  those  making  the  contracting  policies  and  those  working 
within  the  policies  established.  Comparison  of  the  two  data  bases  could  provide  a 
baseline  to  identify  commonalties  and  discrepancies  between  the  two  groups. 

Focus  on  Competency  Evaluation.  The  competencies  in  this  effort  were 
reviewed  only  to  identify  those  competencies  which  have  need  for  further  review  A 
need  exists  to  establish  a  baseline  for  required  competency  proficiency  for  each 
certification  level.  This  would  enable  an  instrument  to  be  drafted  to  determine  i T  the 
competency  importance  perceived  by  the  individual  and  the  established,  required 
proficiency  levels  of  the  competencies  were  congruent.  This  evaluation  is  vita!  because 
of  the  key  role  competencies  play  in  the  whole  training  process.  Competencies  are  the 
building  blocks  by  which  the  training  courses  evolve  to  include  the  topics  and  ultimately 
the  course  structure  and  the  training  program  in  general. 

Survey  Other  Services.  While  this  study  can  be  generalized  across  DOD,  certain 
service-unique  philosophies  may  impact  training,  and  the  career  program  as  a  whole.  A 
survey  targeting  other  services  to  determine  to  what  degree  their  training  needs  are  being 
met  would  allow  for  better  comparison. 
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Evaluation  of  Other  Program  Components  -  Experience  and  Education.  This 
research  only  del  . 'mined  the  extent  to  which  the  training  program  is  sufficiently  meeting 
the  needs  of  AF  contracting  personnel.  The  findings  indicate  that  the  respondents 
perceive  experience  and  education  as  more  important  than  training  in  developing  the 
work  force.  As  such,  experience  and  education  should  be  addressed  individually  in  a 
study  to  determine  to  what  extent  education  and  experience  requirements  are  meeting  the 
needs  of  AF  personnel  in  ensuring  the  AF  has  a  mission  ready  professional  work  force. 

Target  Public  and  Private  Sector  with  a  Survey  Instrument  to  Determine 
Differences  in  Training  Programs.  A  survey  instrument  could  be  placed  in  a 
professional  magazine  or  journal  -  i.e.  National  (  'out  rad  Management  Asst>euitu>n 
magazine  -  which  would  reach  both  audiences.  The  survey  would  try  to  identify  what 
current  training  programs  are  available  -  formal  and  informal  -  and  determine  the 
alternatives  for  training  and  how  effective  these  alternatives  are  perceived.  This  would 
be  a  good  starting  point  for  establishing  new  types  of  training  and/or  reinforcing  the 
training  which  is  already  in  place. 


I 
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Appendix  A:  Survey  Instrument 


The  following  pages  display  the  survey  instrument  as  it  was  presented  to  the 
survey  participants. 


Cover  Page 


AIR  FORCE  INSTITUTE  OF  TECHNOLOGY 

SURVEY 

ON 

AIR  FORCE 

CONTRACTING  PERSONNEL 
TRAINING  NEEDS 


Reference  Code: 


DEPARTMENT  OF  THE  AIR  FORCE 

WASHINGTON  DC 


OFFICE  OF  TH£  ASSISTANT  SECRETi^* 


6  APR  1994 


MEMORANDUM  FOR  CONTRACTING  COURSE  ATTENDEE 


SUBJECT:  Training  Survey 


A  comprehensive  and  responsive  training  program  ts  vital  to  ensure  that  .\ir  Force 
contracting  personnel  are  ready  to  meet  die  acquisition  challenges  of  today  and  tomorrow. 
As  such,  the  evaluation  and  update  of  the  contracting  training  program  is  an  evoluuonary 
process  in  pursuit  of  die  development  of  a  professional  work  force  capable  of  successfully 
fulfilling  our  mission. 


The  attached  survey  seeks  your  opinions  and  experiences  with  the  current  training 
program.  The  results  will  aid  the  Air  Force  Institute  of  Technology  in  their  research  and 
will  also  be  provided  to  functional  managers  throughout  the  Air  Force  and  the  Department 
of  Defense.  Although  your  input  is  strictly  voluntary,  I  strongly  urge  your  participation  in 
this  research  process.  This  is  your  opportunity  to  express  your  concerns  and  ideas  for  the 
future  train  ig  agendas  of  the  contracting  community.  Your  opinions  and  experiences  are 
important  to  us.  I  thank  you  in  advance  for  your  time  and  comments. 


ROBERT  W.  DREWES,  Brig  Gen,  US  AF 


I  Al-ri  pfl 

i  tjjiju 


im  ^r\ r» fni'tinnl 


Assistant  Secretary  (Acquisition) 


Attachment; 

Survey 


Survey  Instructions: 


Purpose:  The  purpose  of  this  survey  is  to  help  identity  strengths  and  weaknesses  in  the  training 
program  for  Air  Force  contracting  personnel.  This  survey  is  being  conducted  by  Air  Force 
Institute  of  Technology  graduate  students  and  is  sponsored  by  the  Air  Force  Program  Executive 
Office  for  Career  Management  at  the  Pentagon.  This  survey  wih  be  used  ic>  identify  areas  of 
training  which  need  improvement.  The  ultimate  goal  is  to  ensure  ih  :t  the  specific  training  needs 
of  Air  Force  contracting  personnel  are  met. 

Anonymity:  Each  survey  is  assigned  a  coded  number  for  adtninistmov  c  purposes  only.  Your 
name  will  not  be  used  or  associated  with  this  survey  in  any  manner 

Results:  The  results  of  this  research  will  be  published  in  an  AF1T  thes  s  in  September  1994  and 
the  final  report  will  be  permanently  stored  with  the  Defense  Technical  Information  Center  (DTIC). 
As  a  participant  in  this  survey,  you  will  have  an  opportunity  to  obtain  a  summary  of  the  findings 
and  conclusions.  Your  instructor  will  make  available  a  sign-up  sheet  for  you  to  indicate  your 
desire  to  receive  a  summary. 

Instructions: 

1.  Use  only  a  number  2  pencil  on  the  answer  sheet. 

2.  DO  NOT  put  your  name  on  the  survey  or  the  answer  sheet. 

3.  Please  answer  every  item. 

4.  Answer  all  items  according  to  your  initial  reaction.  Please  do  not  change  your  response  to 
previous  items  based  on  information  presented  in  later  items. 

5.  Some  items  ask  for  your  opinion  There  are  no  right  or  wrong  opinions.  We  want  to  know 
how  you  view  your  training  needs 

6.  Additional  instructions  are  provided  in  the  surv  ey  where  needed. 

7.  This  survey  has  been  designed  to  take  approximately  30  to  40  minutes.  Do  not  spend  too 
much  time  on  any  particular  question. 

8.  Once  you  have  completed  this  survey,  return  it  together  with  your  answer  sheet  to  the 
instructor. 


Privacy  Act  Statement 

In  accordance  with  AF'R.  12-35,  pani  30,  thfl  following  information  is  provided  as  required  by  the  lYivacy  Act  of  1 974 
a  Authority  5  (JSC  301,  Departmental  Regulations,  and/oi  10  USC  8012,  Secretary  of  the  Air  force  Powers. 
Duties,  Delegation  by  Compensation. 

b  lYincipal  Purpose.  To  sample  Air  Force  contracting  personnel  opinions  and  altitudes  concerning  training 
c  Routine  Uses  To  pimuic  data  us  pari  of  a  A  FI  1  thesis  :auJv 

d  Participation  m  this  survey  is  voluntarv  and  fesjxindeiils  will  not  Ik.*  idem* lied  No  adverse  action  ol  any  kind  ina\ 
be  taken  against  any  individual  who  elects  not  in  j  jrticipatc  in  any  or  all  [\irts  oJ  this  sunev  _ 
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PART  I:  Demographics  -  Please  mark  all  your  responses  directly  on  the  survey  as 
well  as  qu  the  answer  sheet. 


Current  Rank  or  Grade  and  Series:  Indicate  your  current  rank  or  grade.  Answer  only 
one  question  of  the  three  choices  provided.  Please  be  careful  when  indicating  your 
response  on  the  computerized  answer  sheet  provided.  Skip  the  questions  that  do  not 
apply. 


jl.  Officer  (64Px) 

2.  Enlisted  (6C0xx) 

3.  Civilian  (1102) 

1.  0-1 

1.  E-l  to  E-3 

1.  GS-5  or  GS-7 

2.  0-2 

2.  E-4 

2.  GS-9 

3.  0-3 

3.  E-5 

3.  GS-11 

4.  0-4 

4.  E-6 

4.  GS-12 

5.  0-5 

5.  E-7 

5.  GS.GM-13 

6.  0-6 

6.  E-8 

6.  GS/GM-14 

7.  E-9 

7.  GSGM  -15 

4.  Education:  Indicate  the  highest  level  of  education  obtained. 


1.  High  School  Degree  5.  Masters  Degree 

2.  Some  College  6.  Masters  Degree  Plus 

3.  Associates  Degree  7.  Ph.D 

4.  Bachelors  Degree 


5.  Experience:  Indicate  the  number  of  years  of  contracting  experience  you  have 
obtained.  (This  may  be  a  combined  total  for  individuals  with  both  military  and  civilian 
experience. ) _  _ 


1  Less  than  1  year  of  experience  5  11-15  years  of  experience 

2  1  -  2  years  of  experience  6.  16  -  20  year  of  experience 

3.  3-4  years  of  experience  7.  More  than  20  years  of 

4.  5 -10  years  of  experience  experience 
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6.  Supervisory  Experience:  Indicate  the  amount  of  supervisory  experience  you  have 
obtained. 


1 .  No  supervisory  experience 

2.  Less  than  one  year  supervisory  experience 

3.  1-2  years  of  supervisory  experience 

4.  3  -  4  years  of  supervisory  experience 

5.  5-10  years  of  supervisory  experience 

6.  11-15  years  of  supervisory  experience 

7.  More  than  1 5  years  of  supervisory  experience 


7.  Executive/Managemeet  Experience:  Answer  Yes  or  No. 


1.  No 


2.  Yes 


- 1  have  not  held  a  position  of  executive  responsibility  such  as 
Commander,  Deputy  Commander,  Director  or  other  equivalent 
position. 

- 1  have  held  or  am  currently  holding  a  position  of  executive 
responsibility  such  as  Squadron  Commander,  Deputy  Commander, 
Director  or  other  equivalent  responsible  position. 


8.  Present  Job  Title:  Indicate  your  present  job  title. 


1 .  Contract  Negotiator 

2.  Contract  Specialist 

3.  Contract  Administrator 

4.  Procurement  Analyst 


5.  Contract  Price  and/or  Cost  Analyst 

6.  Contracting  Officer  ( ACO,  I  CO.  etc  ) 

7.  Other.  Please  indicate  position  title: 


5.  Contracting  CerUIlc&uuii:  indicate  ine  appropriate  ievei  oi  certiiicauon  oriicialiy 
obtained.  If  you  will  receive  a  certification  upon  completion  of  the  training  class  you  are 
currently  taking,  please  check  that  level. 


1  No  Certification 

2.  Level  I  Certification  Received 


3.  Level  II  Certification  Received. 

4.  Level  III  Certification  Received. 


10.  Type  of  Contracting  Function  Assigned  To:  Indicate  the  appropriate  contracting 
function  currently  assigned  to: 


1 .  Systems  Acquisition 

2.  Operational 

3.  Specialized 

4.  Headquarters 


5.  Contract  Administration  Organization 

6.  Training 

7.  Other:  Please  indicate  function. 
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Part  II  The  Certification  Program 


Background:  To  improve  the  management  and  professionalism  of  the  acquisition 
workforce,  the  Defense  Acquisition  Workforce  Improvement  Act  (DAWIA)  of  1990  was 
enacted.  The  Air  Force,  in  an  effort  to  ensure  complete  mission  ready  support,  initiated 
the  Acquisition  Professional  Development  Program  (APDP)  to  implement  DAWIA 
requirements  APDP  established  a  certification  program  for  all  acquisition  personnel, 
specifying  minimum  education,  experience  and  training  standards  required  to  become 
certified  and  hold  positions  at  each  certification  level.  This  program  has  now  been 
adopted  throughout  the  Department  of  Defense  (DOD).  The  following  table  outlines  the 
mandatory  certification  requirements,  applicable  to  all  DOD  acquisition  employees. 


Level 

Experience 

Professional  Certification  Requirements 
Contracting 

Training 

Education 

I 

1  year 

-  Contracting  Fundamentals 

-  Contract  Pricing 

Degree  or 

24  hours  of  business 

TT 

AA 

0  i/anrc 

■—  J  VUI  o 

„  Ont/ammonf  C' Antmft  T  ->u/ 

-  Intermediate  Contract  Pricing 

-  Intermediate  Contracting  Course 

in  Primary  Assignment 

Scirnc  cis  Levs!  1 

111 

4  years 

-  Executive  Contracting 

-  Executive  Contracting  Course 

Same  as  Level  1 

in  Primary  Assignment 


Please  answer  the  following  questions  about  the  Air  Force  APDP  and  requirements  as 
identified  above.  Responses  for  questions  1 1  through  14  should  be  based  on  the 


following  scale. 

Strongly 

Disagree 

Disagree 

Neutral 

Agree 

Strongly 

Agree 

1 

2 

3 

4 

5 

11.  The  current  certification  requirements  are  sufficient  to  ensure 
that  the  Air  Force  has  a  mission  ready  professional  contracting 

workforce  that  can  provide  effective  customer  support .  1  2  3  4  5 

1 2.  The  current  experience  requirements  are  sufficient  to  ensure 
that  the  Air  Force  has  a  mission  ready  professional  contracting 

workforce  that  can  provide  effective  customer  support .  ..  12  3  4  5 
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13.  The  current  training  requirements  are  sufficient  to  ensure  that  the 
Air  Force  has  a  mission  ready  professional  contracting  workforce 


that  can  provide  effective  customer  support .  1  2  3  4  5 

14.  The  current  education  requirements  are  sufficient  to  ensure  that 
the  Air  Force  has  a  mission  ready  professional  contracting 
work  force  that  can  provide  effective  customer  support .  1  2  3'4  5 


15.  Select  which  of  the  three  requirements,  experience  .  training  or  education,  you 
think  is  most  important  to  ensure  that  the  Air  Force  has  a  mission  ready 
professional  contracting  workforce  that  can  provide  effective  customer  support. 

1.  Experience 

2.  Training 

3.  Education 

How  do  you  view  the  certification  program'’ 


Is  there  anything  additional  that  you  would  like  to  add  pertaining  to  the  certification 
program  and  its  relationship  to  a  mission  ready  professional  workforce. 


|  Part  IH:  The  Mandatory  Training  Program 


Background:  As  part  of  the  certification  program,  certain  training  courses  are  required 
at  each  of  the  three  levels.  The  primary  goal  of  training  is  to  ensure  the  development  of  a 
professional,  mission  oriented,  contracting  workforce.  Although  some  individuals  may 
have  met  their  mandatory  training  requirements  through  an  equivalent  college  program  or 
equivalency  examination,  the  focus  of  this  section  is  the  DOD  training  classes,  Please 
note  that  (he  following  classes  are  listed  by  their  current  training  title  and  vou  tnav  know 
the  course  by  a  slightly  different  title.  If  further  assistance  is  needed,  please  refer  to  the 
last  page  of  this  survey  for  a  more  detailed  listing. 


Rate  the  OVERALL  adequacy  of  the  training  material  presented  as  it  pertains  to  your 
ability  to  perform  your  current  job.  (DO  NOT  RATE  THE  INSTRUCTOR  OR 
QUALITY  of  PRESENTATION,  ONLY  THE  GENERAL  MATERIAL  THA  I 
WAS  PRESENTED  AND  ITS  APPLICABILITY  TO  YOUR  JOB.)  Rate  ALL  the 
courses  you  have  taken  regardless  of  the  mandatory  requirements 

Highly  ,  Highly  ]  Have  Not 

Inadequate  Inadequate  Borderline  Adequate  Adequate  |  Attended 

1  2  3  4  5  |  6 


Level  1  Current  DOD  Training  Courses  Available _  _ 

16.  Management  of  Defense  Acquisition  Contracts  -  Basic .  I  2  3  4  5  |  6 

17.  Central  Systems  Level  Contracting .  12  3  4  5  |  6 

18.  Operational  Level  Contracting .  12  3  4  5  j  6 

19.  Construction  Contracting  Fundamentals .  1  2  3  4  5  \  6 

20.  Principles  of  Contract  Pricing .  1  2  3  4  5  |  6 

21.  Rase  Level  Pricinn  .  1  2  3  4  5  I  6 

22.  Defense  Cost  &  Price  Analysis/Negotiation .  1  2  3  4  5  |  6 


Level  2  Current  DOD  Training  Courses  Available 


23.  Government  Contract  Law .  1  2  3  4  5  |  6 

24.  Intermediate  Pricing .  1  2  3  4  5  |  6 

25.  Management  of  Defense  Acquisition  Contracts  -  Advanced  .1  2  3  4  5  |  6 

26.  Advanced  Contract  Administration .  1  2  3  4  5  |  6 

27.  Base  Contract  Administration .  1  2  3  4  5  |  6 

28.  Advanced  Contract  Management  -  Construction .  1  2  3  4  5  |  6 

29.  Overhead.  Contract  Overhead  Management .  I  2  3  4  5  |  6 

30.  Cost  Accounting  Standards  Workshop .  1  2  3  4  5  |  6 

31.  Defense  Contracting  for  Information  Resources .  12  3  4  5  |  6 
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{Level  3  Current  POP  Training  Courses  Available 

32.  Executive  Contracting .  1  2  3  4  5  |  6 

33.  Management  of  Defense  Acquisition  Contracts -Executive. .  1  2  3  4  5  j  6 

34.  Executive  Contact  Administration . 1  2  3  4  5  j  6 

35.,  Executive  Cost  and  Price  Analysis . 1  2  3  4  5  j  6 


Please  answer  the  following  questions  about  the  mandatory  training  requirements 
identified  on  the  previous  page.  All  questions  should  be  based  on  the  following  scale. 

Strongly  Strongly 

Disagree  Disagree  Neutral  Agree  Agree 

1  2  3  4  5 


36.  The  current  training  program  is  intended  to  familiarize  me  with 

various  aspects  of  contracting .  1  2  3  4  5 

37.  The  current  training  program  is  beneficial  to  my  ability  to  perforin 

my  current  job .  12  3  4  5 

38.  The  current  training  program  is  specific  enough  to  help  me  perform 

my  current  job .  12  3  4  5 


39.  I  usually  receive  training  when  1  need  it .  1  2  3  4  5 

40.  My  training  needs  are  better  met  through  alternate  training  sources  .1  2  3  4  5 

41.  Once  I  have  attended  a  training  course,  1  am  better  able  to 

perform  my  job .  1  2  3  4  5 

42.  After  I  have  attend  a  training  course,  1  am  able  to  apply  the  material 

presented .  I  2  3  4  5 


What  training  class  or  classes,  either  mandatory  or  non-mandatory,  have  you  attended 
that  you  thought  were  most  or  least  beneficial  to  you  in  the  performance  of  your  job. 
Also,  indicate  why  the  classes  were  most  or  least  beneficial. 

Most:  _  _  _  Least: _ 


Is  there  anything  additional  that  you  would  like  to  add  pertaining  to  the  training  portion 
of  the  certification  program  or  about  trainmg  in  general 


Part  IV  Needs  Analysis 


Background:  The  following  79  units  of  instruction  have  been  identified  by  the  Defense 
Contracting  Career  Management  Board  and  faculty  members  of  Defense  schools  as  the 
basis  for  mandatoiy  curriculum  for  DOD  contract  specialists. 


For  each  of  the  following  areas  of  instruction  please  make  two  judgments.  First  rate  the 
importance  of  each  training  objective  as  it  applies  to  your  overall  ability  to  perform  your 
job  by  circling  a  number  from  1  to  5  (1  =  very  unimportant;  2  =  not  important;  3  =  so-so; 
4  =  important;  5  =  very  important.)  Second,  indicate  your  current  level  of  proficiency  in 
each  area  (1  =  no  experience;  2  =  not  proficient;  3  =  somewhat  proficient;  4  =  rather 
proficient;  5  *  highly  proficient). 


Importance  Proficiency 

Importance  to  overall  How  well  1  can  perform 
ability  to  perform  job.  or  demonstrate  this 

abilitv 


>  2 

Determining  the  Need  &  Initiating  the  Acquisition 


§  §  £  g 

%.  5?  £  fX 

>  z  5S  1  > 


Forecasting  Requirements 

43. 

1 

3 

4 

5 

44. 

1 

3 

4 

5 

Acquisition  Planning 

45. 

l 

2 

3 

4 

5 

46. 

1 

2 

3 

4 

5 

Purchase  Requests 

47. 

1 

i 

3 

4 

S 

48. 

1 

2 

3 

4 

5 

Funding  Process 

49. 

1 

2 

3 

4 

5 

50. 

1 

2 

3 

4 

5 

Market  Research 

51. 

1 

2 

3 

4 

5 

52. 

1 

2 

4 

5 

Analyzing  the  Requirement  and  Determining  the  Extent  of  Competition 


Specifications 
Statements  of  Work 
Services  Contracting  Issues 
Sources  of  Supply/Services 
Set-Asides 
8(a)  Procurements 
Competition  Requirements 
Unsolicited  Proposal 


53.  1  2  3  4  5  54.  1  2  3  4  5 
55.  1  2  3  4  5  56.  1  2  3  4  5 
57.  1  2  3  4  5  58.  1  2  3  4  5 
59.  1  2  3  4  5  60.  1  2  3  4  5 
61.  1  2  3  4  5  62.  1  2  3  4  5 
63.  1  2  3  4  5  64.  1  2  3  4  5 
65.  12345  66.  12345 
67.  1  2  3  4  5  68.  1  2  3  4  5 
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Source  Selection  Planning 


Lease  Vs.  Purchase 

69. 

1 

2 

3 

4 

5 

70.  1 

2 

3 

4 

5 

Price  Related  Factors 

71. 

1 

2 

3 

4 

5 

72.  1 

2 

3 

4 

5 

Technical  Evaluation  Factors 

73. 

1 

2 

3 

4 

5 

74.  1 

2 

3 

4 

5 

Method  of  Procurement 

75. 

1 

2 

3 

4 

5 

76.  1 

2 

3 

4 

5 

Procurement/Source  Selection  Plans 

77. 

1 

2 

3 

4 

5 

78.  1 

2 

3 

4 

5 

Setting  Terms  and  Conditions  for  the  Solicitation 

Selection  of  Contract  Type 

79. 

1 

2 

3 

4 

5 

80.  1 

2 

J 

4 

5 

Letter  Contracts 

81. 

1 

2 

3 

4 

5 

82.  1 

2 

3 

4 

5 

Contract  Financing 

83. 

1 

2 

3 

4 

5 

84.  1 

2 

j 

4 

5 

Govnt  Property  &  Supply  Sources 

85. 

1 

2 

3 

4 

5 

86.  1 

2 

3 

4 

5 

Need  for  Bonds 

87. 

1 

2 

3 

4 

5 

88.  1 

2 

3 

4 

5 

Solicitation  Preparation  (IFBs/RFPs) 

89. 

1 

2 

3 

4 

5 

90.  1 

2 

3 

4 

5 

Publicizing  Proposed  Procurements 

91. 

1 

2 

3 

4 

5 

92.  1 

2 

J 

4 

5 

Preaw,  d  Inquiries 

93. 

1 

4 

5 

94.  1 

•-} 

4 

5 

Prebid/  Preproposal  Conferences 

95. 

1 

2 

3 

4 

s 

96.  1 

2 

■'i 

J 

4 

5 

Amending  Solicitations 

97. 

1 

2 

4 

5 

98.  1 

J 

1 

“f 

5 

Canceling  Solicitations  (IFBs/RFPs) 

99. 

t 

2 

3 

4 

5 

100.  1 

2 

4 

5 

Evaluating  Bids  and  Proposals 
Processing  Bids 

101. 

1 

2 

4 

5 

102.  1 

2 

3 

4 

5 

Bid  Acceptance  Periods 

103. 

1 

2 

3 

4 

5 

104.  1 

2 

j 

4 

5 

Late  Bids 

105. 

1 

2 

4 

5 

106.  ! 

2 

-* 

4 

5 

Bid  Prices 

107. 

1 

2 

j 

4 

5 

108.  1 

2 

3 

4 

5 

Respon  iveness 

109. 

1 

2 

4 

5 

110.  1 

2 

4 

5 

Processing  Proposals 

111. 

1 

2 

3 

4 

5 

112.  1 

2 

3 

4 

5 

Technical  Evaluations 

113. 

l 

? 

*> 

J 

4 

5 

114.  1 

2 

3 

4 

S 

Price  Objectives 

115. 

2 

3 

4 

5 

116.  1 

2 

3 

4 

5 

Cost  and  Pricini*  Darn 
-  - 

1 17. 

I 

2 

3 

4 

5 

i  is.  ! 

2 

7 

j 

Audits 

119. 

1 

2 

3 

4 

5 

120.  1 

2 

3 

4 

5 

Cost  Analysis 

12L 

1 

2 

3 

4 

5 

122.  1 

2 

3 

4 

s 

Evaluating  Other  Terms  &  Conditions 

123. 

1 

2 

3 

4 

5 

124.  1 

2 

j 

4 

5 

Competitive  Range 

125. 

1 

L. 

3 

4 

5 

126.  1 

2 

3 

4 

5 

Discussing  Proposals  and  Executin'.!  Awards/Protests  and 

Fraud 

Fact-finding 

127. 

I 

2 

3 

4 

5 

128.  1 

2 

3 

4 

5 

Negotiation  Strategy 

129 

1 

3 

4 

5 

130.  1 

2 

3 

4 

5 

Conducting  Negotiations 

131. 

1 

2 

3 

4 

5 

132.  1 

2 

3 

4 

5 

Mistakes  in  Bids/Proposals 

133. 

1 

3 

4 

5 

134.  1 

0 

3 

4 

5 

Responsibility 

135. 

1 

2 

-> 

-> 

4 

5 

136.  1 

2 

3 

4 

5 

Subcontracting  Requirements 

137. 

1 

2 

3 

4 

5 

138.  1 

2 

3 

4 

5 

Preparing  Awards 

139, 

« 

1 

') 

3 

4 

5 

140.  1 

2 

3 

4 

5 
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Awards  141.  1  2  3  4  5 

Debriefing  143.  1  2  3  4  5 

Protests  145.  1  2  3  4  5 

Fraud  and  Exclusion  147.  1  2  3  4  5 

Initiating  Work  Under  the  Contract  and  Quality  Assurance 

142.  1 
144.  1 
146.  1 
148.  1 

Contract  Administration  Planning 

149.  1  2 

3 

4 

5 

150.  1 

Post-Award  Orientations 

151.  1  2 

3 

4 

5 

152.  1 

Ordering  Against  Contracts 

153.  1  2 

3 

4 

5 

154.  1 

Consent  to  Subcontract 

155.  1  2 

3 

4 

5 

156.  1 

Monitoring,  Inspection  &  Acceptance 

157.  1  2 

3 

4 

5 

158  1 

Delays 

159.  1  2 

3 

4 

5 

160.  1 

Stop  Work 

161.  1  2 

3 

4 

5 

162.  1 

Remedies 

163.  1  2 

3 

4 

5 

164.  1 

Property 

165.  1  2 

3 

4 

5 

166.  1 

Reporting  Performance  Problems 

167,  1  2 

4 

5 

168.  1 

Payments  and  Accounting 

Limitation  of  Costs 

169.  1  2 

3 

4 

5 

170.  1 

Invoices 

171.  1  2 

3 

4 

5 

172.  1 

Unallowable  Costs 

*  f  v 

1  /«J.  1  z. 

n 

A 

n 

e 

J 

1^4  1 

I  1 

Assignment  of  Claims 

175.  1  2 

3 

4 

5 

176.  1 

Collecting  Contractor  Debts 

177.  !  2 

3 

4 

5 

178.  1 

Progress/ Advance  Payments 

179.  1  2 

3 

4 

5 

180.  1 

Price  and  Fee  Adjustments 

181.  1  2 

3 

4 

5 

182.  1 

Accounting  and  Estimating  Systems 

183.  1  2 

*■> 

j 

4 

5 

184.  1 

Cost  Accounting  Standards 

185.  1  2 

3 

4 

5 

186.  1 

Defective  Pricing 

187.  1  2 

3 

4 

5 

188.  1 

Miscellanenus 

Contract  Close-outs 

189.  1  2 

3 

4 

5 

190.  1 

Contract  Modifications/Options 

191.  1  2 

3 

4 

5 

192.  1 

Terminations 

193.  1  2 

3 

4 

5 

194.  1 

Bonds 

195.  1  2 

3 

4 

5 

196.  1 

Claims 

197.  1  2 

3 

4 

5 

198,  1 

Ethi  's/Standards  of  Conduct 

199.  1  2 

3 

4 

5 

200.  i 

2  3 
2  3 
2  3 
2  3 


2  3 
2  3 
2  3 
2  3 
2  3 
2  3 
2  3 
2  3 
2  3 


2  3 
2  3 
2  3 
2  3 
2  3 
2 
2 

2  3 
2  3 
2  3 


2  3 
2  3 
2  3 
2  3 
2  3 
2  3 


What  additional  areas  of  instruction  do  you  think  need  to  be  added  or  deleted? 
Added:  Delete: 


4 

4 

4 

4 


4 

4 

4 

4 

4 

4 

4 

4 

4 

4 


4 

4 

d 

-r 

4 

4 


4 

4 

4 


4 

4 

4 

4 

4 

4 


5 

5 

5 

5 


5 

5 

5 

5 

5 

5 

5 

5 

5 

5 


5 

5 

C 

U 

5 

5 


5 

5 

5 


5 

5 

5 

5 

5 

5 


A- 12 


L»J  L»J 


Contracting  Training  Course  Requirements 


The  following  list  summarizes  the  mandatory  course  requirements  in  the  contracting  career  field  by  level  as 
outlined  in  DoD  5000. 52M,  Career  Development  Program  for  Acquisition  Personnel.  Each  training 
requirement  is  listed  by  its  primary  title  as  assigned  by  the  Defense  Acquisition  University  with  equivalent 
DOD  course  offerings  listed  directly  below.  This  list  is  not  intended  to  be  all  inclusive  Training 
requirements  may  also  be  met  through  an  equivalent  college  program  or  equivalency  examination. 


I  Le  el  l  -  Mandatory.  Complete  two  basic  courses  in  contracting.  One  course  in  contracting 
I  principles  and  one  in  contract  pricing  principles. 


Contracting  Fundamentals 

Management  of  Defense  Acquisition  Contracts-Basic  (SD-4320) 
Central  Systems  Level  Contracting  (G30BR6531-Q10) 
Operational  Level  Cont  acting 
Construction  Contracting  Fundamentals  (CTC-142) 

Contract  Pricing 

Principles  of  Contract  Pricing  (QMT - 1 70) 

Base  Level  Pricing  (G30ZR6534-009) 

Defense  Cost  &  Price  Analysis/Negotiation-PN 


Level  2  -  Mandatory.  Complete  three  intermediate  course.  One  course  in  contract  law,  one  course  in 
intermediate  contract  pricing  principles  and  one  intermediate  course  in  your  primary  assignment. 


Government  Contract  Law 

Government  Contract  Law  (PPM  302) 

Government  Contract  Law-Construction  (CTC-302) 

Government  Contract  Law  (G30ZR6534-007) 

Intermediate  Contract  Pricing  (Mandatory  I  Oct  94) 

Intermediate  Pricing  (QMT-340) 

Intermediate  Contracting  Course  by  Primary  Assignment 

Management  of  Defense  Acquisition  Contracts-Advanccd  (8D-F12) 
Contract  Administration- Advanced  (PPM  304) 

Base  Contract  Administration  (G3ZAR65 1 70-002) 

Advanced  Contract  Management -Construction  (CTC-542) 

Contract  Overhead  Management  (PPM-3SS) 

Cost  Accounting  Standards  Workshop  (ALMC-CF.) 

Defense  Contracting  for  Information  Resources 


Level  3  -  Mandatory.  Complete  two  executive  level  courses.  One  course  in  executive  contracting  and 
one  executive  course  in  your  primary  assignment. 


Executive  Contracting 

Defense  Acquisition  Contracting  Executive  Seminar -ER 
Executive  Contracting  Count  by  Primary  Assignment 

Management  of  Defense  Acquisition  Contracts-Executive  (ALMC-B5) 
Contract  Administration-Executive  (PPM-057) 

Executive  Cost  and  Price  Anaiysis  (QMT-540) 
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Appendix  B:  Matrix  of  Survey  Questions  Related  io  Investigative  Questions 


Table  B-l.  Matrix  of  Survey  Questions 


Investigative  Quesion 

Survey  Question 

1 

11  -  15,36  -42,  OE  1  -4 

2 

11  -  15,  36  - 42,  OE  1  -4 

16-35,  OE  1  -4 

4 

43  -  200 
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Appendix  C:  Survey  luestion  Statistics 


Overall  Population  and  Sample  Statistics 

Table  C-l.  Overall  Statistics 


- - — -  ‘  ■  T 

Population 

Sample 

Number  of 

Population 

Number  of 

Sample 

Personnel 

Percentage 

Personnel 

Percentage 

Officer 

826 

11.81% 

67 

20.94% 

Enlisted 

1339 

19.15% 

77 

24.06% 

Civilian 

4828 

69.04% 

176 

55.00% 

Total 

6993 

100.00% 

320 

100  00% 

Civilian 

Enlisted 

Officer 


50  100  1 
Number  of  Survey  Respondents 


Figure  C-2.  Sample  Statistics 


Survey  Questions  1, 2,  and  3:  Current  Rank  or  Grade 


Table  C-2.  Current  Rank  or  Grade 


IN  umber  of  Respondents 


Figure  C-4.  Number  of  Enlisted  by  Rank 


C-2 


Survey  Questions  1, 2,  and  3:  Current  Rank  or  Grade  (Continued) 


Number  of  Respondents 


Figu  re  C-5.  Number  of  Civilians  by  Grade 


C-3 


Survey  Question  4:  Education 


Officer 


Civilian 


Total 


Table  C-3.  Education  Levels  by  Number  of  Respondents _ 


H.S.  H.S.  +  Associates  Bachelors  Masters  Masters  +  Ph.D. 


_0  0 _ 27 _ 28  _ J_1 _ 0__ 

" .  42  ’  20  12  1  0  0 


27 

28 

J_l_ 

0 

12 

1 

0 

0 

74 

37 

11 

0 

113 

66 

22 

0 

Survey  Question  5:  Contracting  Experience 


Table  C-5.  Contracting  Experience  by  Number  of  Respondents 


<1  Yr 

1-2  Yrs 

3-4  Yrs 

5-10  Yrs 

11-15  Yrs 

16-20  Yrs 

>20  Yrs 

Officer 

16 

17 

3 

3 

4 

'■s 

Enlisted 

3 

12 

24 

26 

10 

-> 

0 

Civilian 

2 

la 

10 

70 

34 

21 

21 

Total 

21 

47 

37 

118 

47 

27 

23 

Table  C-6.  Contracting  Experience  by  Percentage  of  Respondents 


Number  of  Respondents 


Figure  C-7:  Contracting  Experience  Levels  of  Repondents 


C-5 


Survey  Question  6:  Supervisory  Experience 


Number  of  Respondents 


Figure  C-8.  Supervisory  Experience  Levels  of  Respondents 


C-6 


Survey  Question  7:  Executive/Management  Experience 


Table  C-9.  Executive/Management  Experience  by  Number  of  Respondents 


No  Experience 

Some  Experience 

Officer 

48 

19 

Enlisted 

74 

3 

Civilian 

162 

14 

Total 

284 

36 

Table  C-10.  Executive/Management  Experience  by  Percentage  of  Respondents 


Figure  C-9.  Executive/Management  Experience  of  Respondents 


Survey  Question  8:  Present  Job  Title 


Table  C-ll.  Job  Titles  by  Number  of  Respondents 


Negotiator 

Specialist 

Administrator 

Analyst 

Cost/Price 

CO 

Other  1 

Officer 

7 

14 

7 

0 

0 

9 

30  ! 

Enlisted 

1 

39 

17 

0 

0 

12 

8 

Civilian 

16 

68 

23 

14 

15 

*>  i 

-M 

9 

|Total 

24 

121 

47 

14 

15 

52 

47 

10  20  30  40  5 

Number  of  Respondents 


Figure  C-10.  Job  Titles  of  Respondents 
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Survey  Question  9:  Contracting  Certification 


Table  C-13.  Certification  Levels  by  Number  of  Respondents 


Level  0 

Level  I 

Level  II 

Level  III 

Officer 

21 

13 

22 

11 

Enlisted 

29 

24 

24 

0 

Chilian 

33 

IS 

97 

28 

Total 

83 

55 

143  • 

39 

Table  C 

-14.  Certification  Levels  by  Percentage  of  Respondents 

Number  of  Respondents 


Tigur?  C-IL  Certification:  Level  of  Respondents 


Survey  Question  10:  Type  of  Contracting  Function  Assigned  To 


Table  C-15.  Contracting  Function  by  Number  of  Respondents 

if.  1:  ~  a  as  i  nesataes  —  1 1  ■  i  uu  saccga  i,  .  q  i  . -  ■  am  .11  111  ^ c 


Systems  Operational  Specialized  Headquarter^  CAO  Training  Other 


Officer 

10 

28 

7 

8 

6 

3 

% 

Enlisted 

0 

62 

•  3 

0 

O 

8 

Civilian 

30 

79 

27 

12 

13 

% 

13 

Total 

40 

169 

37 

20 

21 

13 

20 

Table  C-16.  Contracting  Function  by  Percentage  of  Respondents 


Systems  Operational  Specialized  Headquarters  CAO  Training  Other 


Officer 

3.13% 

8  75% 

2.19% 

2.50% 

1.88% 

0  94% 

1.56% 

Enlisted 

0.00% 

19.38% 

0.94% 

0.00% 

0.63% 

2.50% 

0  63% 

Civilian 

9.38% 

24.69% 

8.44% 

3.75% 

4.06% 

0  63% 

4.06% 

Total 

1 2.50°  0 

52.81% 

1 1  56% 

6.25% 

6.56% 

4  06% 

6  25°. i 

Figure  C-12.  Contracting  Function  Type  of  Respondents 


Survey  Question  II.:  Sufficiency  of  Certification  F’rugrairai  Requirements 


Table  C-1'7.  Sufficiency  of  F'rogi'iirn_Requireiucnt;s  by  Number  of  Respondents 


Level  I 

Strongly  Disagree 
s 

Disagree 

1 7 

Neutral! 

24 

Agree 

78 

Strongly  Agree 

14 

Level  H 

4 

28 

30 

67 

14 

Level  III 

') 

16 

3 

15 

3 

Total 

11 

61 

57 

160 

31 

Table  C-lJt.  Sufficiency  of  Program  Requirements  by  Percentage  or  Respondents 

^sziM^*^l'rra3:jgg^si-^g.,.:5ss:a5aatfa;£^=xig:j.-=;s5=^:;:;ic;ar.as;s^i.‘5Bsg:saa^.:::ss^2:.^:l=rj=:-=^  ■=*  are  1 —  —•■•--  -  = 


I  Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  I 

1.55% 

5.31% 

7.50% 

24.38% 

4.38% 

Level  11 

1.25% 

8.75% 

9.38% 

20  94% 

4.38% 

Level!  Ill 

0.63% 

5.00% 

0.94% 

4.69% 

0.94% 

3.44% 

19  06% 

17.81% 

so  no% 

0.69% 

C-ll 


Survey  Question  12:  Sufficiency  of  Experience  Requirement 


Table  C-19.  Sufficiency  of  Experience  Requirement  by  Number  of  Respondents 


Strongly  Agree 


Agree 


Neutral 


Strongly  Disagree 


0  10  20  30  40  5 <! 

Number  of  Respondents 


Figure  (’-14.  Sufficiency  of  Experience  Requirements  by  Certification  Levels 


C-12 


Survey  Question  13:  Sufficiency'  of  Training  Requirement 


Tabic  C-21.  Sufficiency  of  Training  Requirement  by  Number  of  Respondents 


Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  I 

5 

'V'y 

34 

68 

Q 

Level  II 

3 

29 

28 

70 

13 

Level  m 

1 

10 

5 

23 

0 

Total 

9 

61 

67 

161 

22 

TabSe  C-22. 

Sufficiency  of  Training  Requirement  by  Percentage  of  Respondents 

Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  I 

1.56% 

6.88% 

10.63% 

21.25% 

2.81% 

Level  II 

0.94% 

9  06% 

8.75% 

21.88% 

4  06% 

Level  HI 

0.31% 

3.13% 

1.56% 

7.19% 

0  00% 

Total 

2.81% 

19.06% 

20.94°  o 

50  31% 

6  XX°  o 

A' 


Figure  C-15.  Sufficiency  of  Training  Requirements  by  Certification  Levels 


C-13 


Survey  Question  14:  Sufficiency  of  Education  Requirement 


Table  C-23.  Sufficiency  of  Education  Requirement  by  Number  of  Respondents 


Level  I 

Level  II 

Level  m 

Strongly  Disagree 

9 

7 

4 

Disagree 

20 

26 

*T 

t 

Neutral 

32 

26 

2 

Agree 

63 
"  65 

25 

153 

Strongly  Agree 

14 

19 

1 

34 

Total 

20 

53 

60 

Table  C-24. 

Sufficiency  of  Education  Requirement  by  Percentage  of  Respondents 

Strongly  Disagree 

Disagree 

Neutral 

Agree 

Str  ongly  Agree 

Level  I 

2.81% 

6  25% 

10.00% 

19.69% 

4.38% 

Level  11 

2.19% 

8.13% 

8.13% 

20  31% 

5.94% 

Level  ill 

1.25% 

2.19% 

0.63% 

7.81% 

0.31% 

Total 

6.25% 

16.56% 

18  75% 

4781% 

l')03% 

Figure  (  -16.  Sufficiency  of  Education  Requirements  by  Certification  Levels 


C-14 


Survey  Question  15:  Most  Important  Certification  Requirement 


Table  C-25.  Most  Important  Requirement  by  Number  of  Respondents 


Level  I 

Experience 

69  ~ 

Education 

56 

Training 

~  9 

Level  II 

81 

43 

15 

Level  HI 

28 

8 

3 

Total 

178 

107 

27 

Table  C-26.  Most  Important  Requirement  by  Percentage  of  Respondents 


'  Experience 

Education 

■  nir-  "i| 

Training 

Level  I 

22.04% 

17.89% 

2.88% 

Level  II 

25.88% 

13.74% 

4.79% 

Level  HI 

8.95% 

2.56% 

0.96% 

Total 

56  87% 

34. 1  o% 

8  63°  o 

r 
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Table  C-27.  Survey  Qtieslion  16  to  33:  Adequacy  of  Current  DO?)  Training  Courses  -  All  Respondents 
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C- 28.  Survey  Question  16  to  35:  Adequacy  of  Current  POD  Training  Courses  -  Level  I  Respondents 
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-29.  Survey  Question  16  to  35:  Adequacy  of  Current  POP  Training  Courses  -  l.evel  II  Respondents 
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Survey  Question  36:  Training  Program  is  Intended  to  Familiarize 


Table  C-31.  Training  Program  Familiarization  by  Number  of  Respondents 


Level  ! 

Strongly  Disagree 

Disagree 

r 

Neutral 

11 

Agree 

91 

Strongly  Agree 

30 

Level  11 

1 

'S 

-> 

14 

93 

29 

Level  111 

1 

0 

1 

31 

6 

Total 

'  4  ! 

5 

-26 

215 

65 

Table  C-32.  Training  Program  Familiarization  by  Percentage  of  Respondents 


‘  Strongly  Disagree  i 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  I 

!  \63% 

0,63%  ' 

3.49% 

1  28.89%  ; 

9.52% 

Level  11 

|  0.32%  | 

0.95% 

4.44% 

1  29.52% 

9.21% 

Level lU 

0.32% 

0.00% 

0.32% 

9.84% 

1.90% 

Total 

1.27% 

1.59% 

8.25% 

!  68.25% 

20.63% 

□  Level  I  □  Level  11  i  Level  111 


Strongly  Agree 


Agree 


Neutral 


Disagree 


Strongly  Disagree 


0  20  40  60  80  100 

Number  of  Respondents 

Figure  C-18.  Training  Familiarization  by  Certification  Levels 
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Survey  Question  37:  Training  Program  is  Beneficial  to  Ability  to  Perform  Job 


a 


Table  C-33.  Program  Beneficial  to  Performance  by  Number  of  Respondents 


i  Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  I 

0 

8 

21 

82 

27 

Level  II 

j 

7 

30 

76 

26 

Level  III 

1 

2 

6 

24 

6 

Total 

2 

17 

57 

—  •  —  ‘;t- 

182 

59 

T able  C-34.  Program  Beneficial  to  Performance  by  Percentage  of  Respondents 


Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  I 

0.00% 

2.52% 

6.62% 

25.87% 

8.52% 

Level  II 

0.32% 

2.21% 

9.46% 

23.97% 

8.20% 

Level  III 

0.32% 

0.63% 

1.89% 

7.57% 

1.89% 

Total 

0.63% 

5.36% 

17.98% 

57  41% 

18  61% 
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Survey  Question  38:  Training  Program  is  Specific  Enough 


Tabie  C-35.  Training  Program  is  Specific  Enough  by  Number  of  Respondents 


1 

Level  I 

Level  13 

Strongly  Disagree 

. 3 

Disagree 

'I') 

27 

Neutral 

41 

33 

Agree 

61 

63 

Strongly  Agree 

12 

14 

Level  EH 

1 

7 

8 

20 

3 

Total 

6 

56 

82 

144 

29 

Table  C-36. 

Training  Program  is  Specific  Enough  by 

Percentage  of  Respondents 

1  1 

| 

Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  I 

0.63% 

6.94% 

12.93% 

19.24% 

3.79% 

Level  D 

0.95% 

8.53% 

10.41% 

19.87%  , 

4.42% 

Level  EH 

0.32% 

;  2.21%  • 

2.52% 

6.31% 

0.95% 

Total 

1  89% 

17  67% 

25.87% 

45.43% 

9.15% 

0  10  20  30  40  50 

Number  of  Respondents 


Figure  C-20.  Training  is  Specific  Enough  by  Certification  Levels 
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Survey  Question  39:  Receipt  of  Training  When  Needed 


Table  C-37.  Receipt  of  Training  by  Number  of  Respondents 


Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  I 

29 

38 

29 

34 

8 

Level  11 

29 

38 

21 

43 

9 

Level  ID 

1 

8 

6 

Total 

59 

84 

52 

99 

23 

Table  C-38.  Receipt  of  Training  by  Percentage  of  Respondents 


Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  I 

9.15% 

11.99% 

9  15% 

10.73% 

2.52% 

Level  H 

9.15% 

11.99%  s 

6.62% 

13.56% 

2.84% 

Level  ID 

0.32% 

2.52% 

0.63% 

6.94% 

1.89% 

Total 

18.61% 

26.50% 

16.40% 

31.23% 

7.26% 

Figure  C-21.  Receipt  of  Training  by  Certification  Level: 


Survey  Question  40:  Training  Needs  Met  Through  Alternate  Training  Sources 


Table  C-39.  Alternate  Training  Sources  by  Number  of  Respondents 


Level  I 

Strongly  Disagree 
*6 

Disagree 

37 

Neutral 

61 

Agree 

29 

Strongly  Agree 

S 

Level  11 

9 

37 

56 

25 

10 

Level  HI 

-s 

20 

12 

5 

u 

Total 

17 

94 

129 

59 

15 

Table  C-40.  Alternate  Training  Sources  by  Percentage  of  Respondents 

Level  I 

Strongly  Disagree 

1.92% 

Disagree 

11.82% 

Neutral 

19.49%  ~ 

Agree 

9.27% 

Strongly  Agree 

1.60% 

Level  H 

2.88% 

11.82% 

17.89% 

7.99% 

3.19% 

Level  IH 

0.64% 

6.39% 

3.83% 

1  60% 

0.00% 

Total 

i1— - - — - 

6  43°  o 

30  03°  o 

41  21% 

1 8.85% 

4  TO0  0 

Figure  C-22.  Alternate  Training  Sources  by  Certification  Levels 


Survey  Question  41:  Better  Able  to  Perform  Job  After  Training 


Table  C-41.  Ability  After  Training  by  Number  of  Respondents 


Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  I 

0 

6 

26 

80 

26 

Level  II 

3 

7 

28 

81 

21 

Level  III 

0 

1 

13 

3 

Total 

3  ■ 

14 

67 

183 

50 

Table  C-42.  Ability  After  Training  by  Percentage  of  Respondents 


Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

[Level  I 

0.00% 

'  1.89% 

8.20% 

'  25.24% 

8  20% 

Level  II 

0.95% 

2.21% 

8.83% 

:  25.55% 

6.62% 

Level  IP 

0.00% 

0.32%  ; 

4.10% 

6.94% 

0.95% 

Total 

0.95% 

■  4.42% 

21.14% 

57.73% 

15.77% 

;  E2  Level  I  □  Level  II  @  Level  III . 
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Survey  Question  42:  Ability  to  Apply  Material  After  Training 


Table  C-43.  Ability  to  Apply  Material  by  Number  of  Respondents 


Strongly  Disagree 

Disagree  : 

Neutral 

Agree 

Strongly  Agree 

Level  I 

0 

8 

31 

74 

25 

Level  D 

1 

o 

29 

81 

20 

Level  m 

0 

14 

20 

Total 

1 

20 

74 

175 

47 

Table  C-44.  Ability  to  Apply  Material  by  Percentage  of  Respondents 


1  Strongly  Disagree 

Disagree 

Neutral 

Agree 

Strongly  Agree 

Level  I 

0.00% 

2.52% 

978%  : 

23.34% 

7.89% 

Level  11 

0.32% 

2.84% 

9.15% 

25.55% 

6.31% 

Level  m 

0.00% 

0.95% 

4.42% 

6.31% 

0.63% 

Total 

0.32% 

6.31% 

23.34% 

55.21% 

14  83% 

0  20  40  60  80  100 


Number  of  Respondents 

Figure  C-24.  Ability  to  Apply  Material  by  Certification  Levels 
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Appendix  D:  Competencies  -  Survey  Ouest*ons  43  -  200 


This  appendix  reports  the  following: 

1 .  An  overall  ranking  of  the  79  units  of  instruction  (competencies)  by  entire 
sample  population  and  by  certification  level. 

2.  A  graphical  representation  of  importance  and  proficiency  by  entire  sample 
population  and  within  each  certification  level. 

3.  A  comparison  of  the  most  and  least  important  unit  of  instruction  by  sample 
population  and  within  each  certification  level. 

4  A  comparison  of  rank  order  correlations  by  sample  population  and  by 
certification  level. 
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Table  D-2.  Level  I  Ranking  of  Units  of  Instruction  fcy  Importance  in  Percentages  (Continued) 
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Table  D-3.  L  evel  II  Ranking  of  Units  of  Instruction  by  Importance  in  Pencentages  (Continued) 
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Table  D-4.  Level  U1  Ranking  of  Units  of  Instruction  by  Importance  in  Percentages  (Continued) 
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king  of  linits  of  Instruction  by  Importance  -  Level  II  Respondents 
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Figu  re  D-4.  Ranking  of  Lnits  of  Instruction  by  Importance  -  Level  III  Respondents 


Table  D-5.  Comparison  of  Importance  of  Units  of  instruction  -  Overall  and  Within  Levels 
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Table  P-S.  Comparison  of  Importance  of  Units  of  Instruction  -  Overall  and  Within  Levels  (Continued) 
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Tabic  P-5.  Comparison  of  Importance  of  Units  of  Instruction  -  Overall  and  Within  Levels  (Continued) 
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21  Fact-finding 

127 

78  68 

21  Contract  Modifications'Options 

!  9 : 

87  18 

22  Awards 

141 

77.94 

22  Specifications 

53 

85  00 

23  Publicizing  Proposed  Procurements 

91 

77  38 

23  Technical  Evaluation  Factors 

73 

85  00 

24  Mistakes  in  Bids/ Proposals 

133 

77.38 

24  Competitive  Range 

125 

84  62 

25  Unallowable  Costs 

173 

77.20 

25  Preparing  Awards 

1.39 

84  (.2 

26  Acquisition  Planning 

45 

76  82 

26  Evaluating  Other  Terms  &  Conditions 

123 

84  ol 

27  TVrm  mat  inns 

103 

76  65 

77  FunHinn  Prr\r^cc 

49 

s'1  so 

28  Price  Related  Factors 

71 

76  26 

28  Publicizing  Proposed  Procurements 

91 

82  5C 

2V  Evaluating  Other  Terms  &  Conditions 

123 

75  92 

29  Amending  Solicitations 

97 

82  50 

30  Contract  Administration  Planning 

149 

75.74 

30  Responsiveness 

109 

82.50 

31  Audits  i 

119 

75.00 

31  Technical  Evaluations 

1  13 

82  50 

32  Technical  Evaluation  Factors 

73 

74.82 

32  'Reporting  Performance  Problems 

167 

82.05 

33  Bid  Prices 

107 

73.73 

33  Price  Related  Factors 

71 

77  50 

34 1  Protests 

145 

73  53 

34  'Termi  nations 

193 

76  93 

35  ]  Processing  Bids 

101  j 

73  40 

35  Sources  of  Supply/Services 

59 

75  00 

36 '  Funding  Process 

49 

72.86 

36 1  Preaward  Inquiries 

93 

75  00 

37  Prebid/Preproposal  Conferences 

95 

72.27 

37  Bid  Acceptance  Periods 

103 

75  00 

38  Invoices 

171 

7i  32 

38  Audits 

1  19 

75  00 

39  Ordering  Against  Contracts 

!  53 

70  60 

39  Claims 

197 

74  39 

40  Post-Award  Orientations 

151 

70  59 

40  Subcontracting  Requirements 

137 

74  36 

41  Monitoring,  Inspection  &  Acceptance 

157 

70  58 

41  Ordering  Against  Contracts 

153 

74  36 

42  Contract  Close-outs 

189 

70  58 

42  Purchase  Requests 

47 

72  50 
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Table  B-6.  Rwk  Order  Correlations  of  Competencies 


ot 

£ 

E 

3 

z 

e 
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L. 
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c 

c 

o 
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s 

<u 

C 

a* 

flj 

e 
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3 

o 

DC 

O' 

u 

QC 

O' 
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1 

57  Services  Contracting  Issues 

061 

1 

59  Sources  of  Supply/Services 

0  59 

2 

59  Sources  of  Supply/Services 

061 

2 

57  Services  Contracting  Issues 

0  53 

3 

91  Publicizing  Proposed  Procurements 

0  56  1 

3 

199  Ethics/Standards  of  Conduct 

0  52 

4 

87  Need  for  Bonds 

0  55 

4 

171  Invoices 

0  50 

5 

199  Ethics/Standards  of  Conduct 

0  54 

5 

51  Market  Research 

0  50 

6 

75  Method  of  Procurement 

0  54 

6 

87  Need  for  Bonds 

0  50 

7 

65  Competition  Requirements 

0  53 

7 

1 57  Monitoring,  Inspection  &  Acceptance 

0  49 

8 

171  Invoices  i 

0.53 

8 

47  |  Purchase  Requests 

0  49 

9 

47  Purchase  Requests 

0  53 

9 

141  Awards 

0  48 

10 

103  Bid  Acceptance  Periods 

0  50 

10 

103  Bid  Acceptance  Periods 

0  47 

II 

107  Bid  Prices 

0  so 

It 

<>5  Competition  Requirements 

■>  4'  | 

12 

1 53  Ordering  Against  Contracts 

0  50 

12 

91  Publicizing  Proposed  Procurements 

II  47 

13 

101  Processing  Bids 

0  so 

13 

107  Bid  Prices 

0  45 

14 

109  Responsiveness 

0.50 

14 

135  Responsibility 

0  45 

15 

67  Unsolicited  Proposal 

0  50 

15 

43  Forecasting  Requirements 

0  44 

16 

141  Awards 

0.49 

16 

5  5  Statements  of  W ork 

0  44 

17 

71  .Price  Related  Factors 

049 

17 

105  Late  Bids 

0  43 

18 

1 1 1  Processing  Proposals 

0  49 

18 

75  Method  of  Procurement 

0  43 

19 

1 35  Responsibility 

049 

19 

101  Processing  Bids 

O  4  t 

20 

97  Amending  Solicitations 

0  48 

20 

109  Responsiveness 

U  4  3 

21 

195  Bonds 

0  48 

21 

195  Bends 

0  42 

22 

149  Contract  Administration  Planning 

0  48 

22 

179  Progress/ Advance  Payments 

O  42 

23 

83  Contract  Financing 

0  48 

23 

1 53  Ordering  Against  Contracts 

041 

24 

105  Late  Bids 

0  48 

24 

o7  Unsolicited  Proposal 

0  41 

25 

81  Letter  Contracts 

0  48 

25 

83  Contract  Financing 

O  40 

26 

5 1  Market  Research 

0  48 

26 

127  Fact-finding 

0  40 

27 

1  57  Monitoring,  Inspection  &  Acceptance 

0.48 

27 

49  Funding  Process 

0  40 

28 

127  Fact-finding 

0  47 

23 

71  Price  Related  Factors 

0  40 

29 

43  forecasting  Requirements 

0  47 

29 

89  Solicitation  Preparation  (IFBs/RFPs) 

0  40 

30 

77  Procurement/Source  Selection  Plans 

0  47 

30 

i69  Limitation  of  Costs 

o  ;><) 

31 

89  Solicitation  Preparanon  (IFBs/RFPs) 

0.47 

31 

151  Post-Award  Orientations 

0  38 

32 , 

93  Preaward  Inquiries 

0.46 

32 

97  ,  Amending  Solicitations 

037 

33^ 

139  Preparing  Awaids  _  J 

0  46 

33 

Ls9  Delays 

0  37 

34 

1 25  Competitive  Range 

0  45 

34 

1 67  Reporting  Performance  Problems 

0  37 

35a 

159  Delays 

045 

35_ 

161  Stop  Work 

0.37 

36 

85  Govnt  Property  &  Supply  Sources 

045 

36 

149  Contract  Administration  Planning 

0  36 

37 

1 5 1  Post-Award  Orientations 

045 

37 

139  Preparing  Awards 

0  36 

38 

9?  Prebid/Preproposa!  Conferences 

0  45 

38 

63  8(a)  Procurements 

0  35 

39 

69  Lease  Vs  Purchase 

U  44 

39 

!‘>1  Contract  Modifications  Options 

(i  35 

40 

1 69  Limitation  of  Costs 

0  44 

40 

165  Property 

0  35 

41 

1 1 5  Price  Objectives 

0  44 

41 

163  Remedies 

0  35 

!  42 

79  Selection  of  Contract  Type 

0  44 

42 

125  Competitive  Range 

0  34 
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Table  D-6.  Rank  Order  Correlations  of  Competencies  (Continued) 


43  143  Debriefing  0  43 

44  55  Statements  of  Work _ _  0  43 

45  16]  Stop  Work  "  " _  0  43 

46  1 1 3  Technical  Evaluations  0  43 

47  63  8(a)  Procurements  0  42 

48  61  Set-Asides  0  42 

49  123  Evaluating  Other  Terms  &  Conditions  0  4 1 

50  179  Progress/ Advance  Payments  0.41 

51  137  Subcontracting  Requirements  0  41 

52  197  Claims  _  _  0  40  J 

53  191  Contract  Modifications/Opfions  0  40 

54  167  Reporting  Performance  Problems  0  40 

55  99  Canceling  Solicitations  (IFBs/RFPs)  0  39 

56  165  Property  _  ~  _ “  0239 

57  163  Remedies  0  39 

58  H  7  Cost  and  Pricing  Data  _  0.38 

59  40  Funding  Process  0  38 

60  53  Specifications  0  38 

6 1  73  Technical  Evaluation  Factors  0  38 

62  1 55  Consent  to  Subcontract  0.37 

63  1 29  Negotiation  Strategy  0  37 

64  183  Accounting  and  Estimating  Systems  0  35 

65  175  Assignment  of  Claims _ _ 0  35 

66  121  Cost  Analysis  0  35 

67  181  Price  and  Fee  Adjustments  0  35 

68  131  Conducting  Negotiations  0  34 

69  1 89  Contract  Close-outs  0  32 

70  133  Mistakes  in  Bids/Proposals  0  32 

71  193  Terminations  0  32 

72  173  Unallowable  Costs  0  32 

7J  119  Audits  0  31 

74  I  77  Collecting  Contractor  Debts  0  27 

75  185  Cost  Accounting  Standards  0  27 

1  *76  I  as  Protests  0  25 

|  77  187  Defective  Pricing  0  24 

[  78  41*  Acquisition  Planning  0  23 

79  147  Fraud  and  Exclusion  0  17 


•13 

85  Govnt  Property  &  Supply  Sources 

0  34 

44 

1 1 1  Processing  Proposals 

0.34 

45 

137  Subcontracting  Requirements 

0  34 

46 

155  Consent  to  Subcontract 

0  33 

47 

69  Lease  Vs  Purchase 

u.  33 

48 

8 1  Letter  Contracts 

0  33 

49 

93  Preaward  Inquiries 

0  33 

50 

77  Procurement/Source  Selection  Plans 

0  33 

51 

61  Set-Asides 

0  33 

52 

99  Canceling  Solicitations  (IFBs/RFPs) 

0  32 

53 

129  Negotiation  Strategy 

0  32 

54 

115  Price  Objectives 

0  32 

55 

53  Specifications 

0  32 

56 

95  Prebid/Preproposal  Conferences 

0  31 

57 

79  Selection  of  Contract  Type 

031 

58 

197  Claims 

0  2" 

59 

1  3  I  Conducting  Negotiation*. 

n  2'1 

60 

1 1 7  Cost  and  Pricing  Dam 

o  :s 

61 

73  Technical  (/valuation  Factors 

(l  28 

62 

113  Technical  Evaluations 

0  28 

63 

1 23  Evaluating  Other  Terms  3c  Conditions 

0.25 

64 

143  Debriefing 

0  24 

65 

193  Terminations 

0  24 

66 

189  Contract  Close-outs 

0  23 

67 

133  Mistakes  in  Bids/Proposals 

0  22 

68 

173  Unallowable  Costs 

0  22 

69 

183  Accounting  and  Estimating  Systems 

0  21 

70 

121  Cost  Analysis 

o2l 

71 

45  Acquisition  Planning 

0  I1 

72 

1 8 1  Price  and  Fee  Adjustments 

i)  !  S 

73 

185  Cost  Accounting  Standards 

0  1  5 

74 

1 75  Assignment  of  Claims 

O  14 

75 

1 87  Defective  Pricing 

o  12 

IX. 

1  1  C  11 _ .  — 

i  t .•  «i cm. :>i:> 

o  i  2 

T 

177  Collecting  Contractor  Debts 

0  |0 

78 

1  19  Audits 

0  18 

79 

147  Fraud  and  Exclusion 

0  0l 

jo  ro 


Table  D-6.  Rank  Order  Correlations  of  Competencies  (Continued) 


Table  P-6.  Rank  Order  Correlations  of  Competencies  (Continued) 


[43 

69  Lease  Vs  Purchase 

0.50 

43 

85  Govnt  Property  &  Supply  Sources 

0  59 

44 

141  Awards 

0  49 

44 

75  Method  of  Procurement 

0.59 

45 

127  Fact-finding 

0.49 

45 

1 79  Progress/Advance  Payments 

0  59 

46 

i  43  Debriefing 

0  48 

46 

109  Responsiveness 

(1  59 

47 

5 1  Market  Research 

0.48 

47 

55  Statements  of  Work 

0  59 

48 

1 57  Monitoring,  Inspection  &  Acceptance 

048 

48 

195  Bonds 

0.58 

49 

73  Technical  Evaluation  Factors 

0  48 

49 

127  Fact-finding 

0.58 

50 

1 6 1  Stop  Work 

0.47 

50 

103  Bid  Acceptance  Periods 

0.57 

51 

169  Limitation  of  Costs 

0  46 

51 

1 87  Detective  Pricing 

0  57 

52 

1 8 1  Price  and  Fee  Adjustments 

046 

52 

99  Canceling  Solicitations  (iFBs/RFPs) 

0.56 

53 

1 65  Property 

046 

53 

1 29  Negotiation  Strategy 

0.56 

54  | 

1 67  Reporting  Performance  Problems 

0.46 

54 

167  Reporting  Performance  Problems 

0.56 

55 

173  Unallowable  Costs 

0.46 

55 

155  Consent  to  Subcontract 

0.55 

56 

1 83  Accounnng  and  Estimating  Systems 

0.45 

56 

1 57  Monitoring,  Inspection  &  Acceptance 

0  55 

57 

1 77  Collecnng  Contractor  Debts 

0.45 

57 

49  Funding  Process 

0.54 

58 

1 1 5  Price  Objectives 

045 

58 

1 0 1  Processing  Bids 

0.53 

59 

16 1  Contract  Modifications  Options 

<1  44 

59 

41  Forecasting  Requirements 

•1*1 

il 

60 

1  1  7  Cost  and  Pi  icing  Data 

U  44 

60 

53  Specifications 

0  5  1 

61 

53  Specifications 

0  44 

61 

183  Accounting  ;uul  Estimating  SyMoms 

M  4')  ! 

62 

137  Subcontracting  Requirements 

0  43 

62 

185  Cost  Accounting  Standards 

(J  49 

63 

1 19  Audits 

0.42 

63 

57  Services  Contracting  Issues 

0  47 

64 

1 89  Contract  Close-outs 

0.42 

64 

107  Bid  Prices 

0  4o 

65 

1 2 1  Cost  Analysis 

041 

65 

147  Fraud  and  Exclusion 

0.46 

66 

1 33  Mistakes  in  Bias/Proposals 

0.41 

66 

5 1  Market  Research 

04S 

67 

49  Funding  Process 

0.40 

67 

1 73  Unallowable  Costs 

0  45 

68 

163  Remedies 

0  40 

68 

189  Contract  Close-outs 

0  4  1 

69 

5  5  Statements  of  Work 

0  40 

69 

105  Late  Bids 

0  4  1 

70 

1 55  Consent  to  Subcontract 

0  39 

70 

6 1  Set-  Asides 

11  4  0 

71 

129  Negotiation  Strategy 

0 .39 

71 

1 77  Collecting  Contractor  Debts 

0  3<> 

72 

1 79  Progress/Advance  Payments 

0  39 

72 

165  Property 

II  19 

73 

|9j  Terminations 

0  38 

73 

1 1 9  Audits 

II 37 

74 

185  Cost  Accounting  Standards 

0  34 

74 

7')  Selection  of  Contract  Type 

1)  37 

75 

1 3  1  Conducting  Negotiations 

0  31 

75 

1  1 7  ( ,'ost  and  Pricing  Data 

0  34 

76 

1 87  Defective  Pricing 

n  *>o 

V  -  • 

76 

63  o{a)  1  rOCuiClJiCffu* 

U  JJ 

77 

145  Protests 

0  28 

77 

77  Procurement/Source  Selection  Plans 

(i  3  1 

78 

45  Acquisition  Planning 

0  24 

78 

73  Technical  Evaluation  Factors 

u  3  u 

79 

147  Fraud  and  Exclusion 

0  22 

79 

45  Acquisition  Planning 

0  IX 

D- 25 


Appendix  E:  Open  Ended  Questions 


This  appendix  reports  the  responses  to  the  opened  ended  questions  bv  an  index  of 
response  categories,  a  ranking  of  responses  by  categories,  and  a  sanitized  listing  of  the 
responses. 

Open  Ended  Question  1 :  How  do  you  view  the  certification  program?  (See  note 
1  below.) 

Open  Ended  Question  2:  Is  there  anything  additional  you  would  like  to  add 
pertaining  to  the  certification  program  and  its  relationship  to  a  mission  ready  professional 
workforce.  (See  note  1  below.) 


Open  Ended  Question  3.  What  training  class  or  classes,  either  mandator y  ui 


non-mandatory,  have  you  attended  that  you  thought  were  most  or  least  beneficial  to  you 
in  the  performance  of  your  job’  Also,  indicate  why  the  classes  were  most  or  least 
beneficial. 

Open  Ended  Question  4  Is  there  anything  additional  that  you  would  like  to  add . 
pertaining  to  the  training  portion  of  the  certification  program  or  about  training  in  general. 
(See  note  1  below.) 

Open  Ended  Question  5:  What  additional  areas  of  instruction  do  you  think  need 
to  b<  added  or  deleted?  (See  Note  2  below.) 


Note  I :  Responses  to  questions  1 . 2  and  4  were  combined  because  respondents  did  not  always  answer  llie  specific 
question  being  asked  Often,  responses  contained  many  distinct  and  separate  thoughts,  ideas,  or  opinions,  many  of  which 
answered  more  Ilian  one  question  at  a  tune 

Note  2:  Open  ended  question  5  was  not  evaluated  due  to  lack  of  responses 


Table  E-l.  Index  of  Response  Categories 


I.  Certification  Program  Satisfaction  and  Importance 

1.0  Program  is  Necessary  and/or  Needed 

2.0  Program  is  Perceived  as  Having  Value/  Worth 

3  0  Program  is  a  Good  Start  Towards  a  Professional  Workforce 
_ 4.0  program  is  Meeting  the  Goal  to  Improve  the  Workforce 

5.0  Program  Provides  Positive  Changes  and  Improvements 
6.0  Importance  of  the  Certification  Program  Standards 

6.1  importance  of  Experience 

_  6.  2  importance  of  T raining 

' _ 6.3  Importance  of  Education 

II.  Certification  Program  Dissatisfaction  and  Concerns 
1.0  Program  is  Meaningless/Unimportant 

2.0  Program  is  Not  Meeting  its  Intended  Purpose 
3.0  Program  is  a  Waste  ot  Resources 

4  0  Program  Keeps  Changing 

5.0  Program  Does  Not  Reflect  Ability  to  Perform  the  Job 

5. 1  Higher  Education  Does  Not  Equate  to  Ability  to  Perf  orm  the  Job 

6.0  Program  Standards  are  Too  Low  . 

6.L  Expenence  Requirements  are  Too  Low 

6.2  Education  Requirements  are  Too  Low 

7.0  Enlisted  Concerns  About  the  Certification  Program 
8.0  Cither  Comments  and  Concerns  Pertaining  to  the  Certification  Progran 
HI.  Certification  Program  and  Established  Standards 
1.0  Experience  Standards  -  Comments  and  Concerns 
2.0  Training.  Standards  -  Comments  and  Concerns 

2. 1  Training  Availability 

2.2  Training  Applicability 

2.3  Training  Needs  and  Suggestions 

2.4  On-The-Job  Training 

2.5  Refresher/Follow-on  Training 

3.0  Education  Standards  -  Comments  and  Concerns 

3.1  Education  Funding  Issues 

3.2  Education  Discipline  Concerns 

3.3  Dissatifaction  with  Education  Requirement 

IV.  Training  Courses  Perceived  Most  Beneficial 

V.  Training  Courses  Perceived  Least  Beneficial 


Page  No. 
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Table  E-2.  Questions  1,  2,  and  4  -  Ranking  of  Responses 


I.  Certification  Program  Satisfaction  and  Importance 

1.0  Program  is  Necessary  and/or  Needed 

2.G  Program  is  Perceived  as  Having  Value/Worth 

3.0  Program  is  a  Good  Start  Towards  a  Professional  Workforce 

4.0  Program  is  Meeting  the  Goal  to^Improve  the  Workforce 

5.0  Program  Provides  Positive  Changes  and  Improvements 

6.0  Importance  of  the  Certification  Program  Standards 

6.1  Importance  of  Experience 

6.2  Importance  of  Training 
63  Importance  of  Education 

II.  Certification  Program  Dissatisfaction  and  Concerns 
1.0  Program  is  Meaningless- Unimportant 

2.0  Program  is  Not  Meeting  its  Intended  Purpose 
_  3.0  Program  is  a  Waste  of  Resources 
4.0  Program  Keeps  Changing 

5.0  Program  Does  Not  Reflect  Ability  to  Perform  the  Job 

5.1  Higher  Education  Does  Not  Equate  to  Ability  to  Perform  the  Job 
6.0  Program  Standards  are  Too  Low 

6. 1  Experience  Requirements  are  Too  Low 

6.2  Education  Requirements  are  Too  Low 

7.0  Enlisted  Concerns  About  the  Certification  Program 

8.0  Other  Comments  &  Concerns  Pertaining  to  the  Certification  Program 

III.  Certification  Program  and  Established  Standards 
1.0  Experience  Standards  -  Comments  and  Concerns 
2.0  Training  Standards  -  Comments  and  Concerns 

2.1  Training  Availability 

2.2  Training  Applicability 

2.3  Trailing  Needs  and  Suggestions 
y  2.4  On-The-Jcb  Training 

2. 5  Ref reshei  /FoUow-on  ^Training 
3.0  fidu-xti op  Standards  -  Comments  and  Concerns 

3.1  Education  Funding  Issues 

3.2  Education  Discipline  Concerns 

3.3  Disst  tifaction  with  Education  Requirements 
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Table  £-3.  Question  3  -  Ranking  or  Responses 


IV,  Training  C  ;urses  Perceived  Most  Beneficial 
Level I  Courses 

Management  of  Defense  Acquisition  Contracts  -  Basic 
C entral  Systems  Level  Contracting 
Operational  Contracting  Fundamentals 
Principles  of  Contract  Pricing 
Bane  Level  Pricing 

Defense  Cost  and  Price  Analysis/Negotiation 
Level  IlCourses 

_ Government  Contract  Law 

Intermediate  Pricing 

Management  of  Defense  Acquisition  Contracts  -  Advanced 
Contract  Administration  -  Advanced 
Base  Contract  Administration 
C  ontract  Overb  ead  Management 
Level  HI  Courses 

Defense  Acquisition  Contracting  Executive  Seminar 
Others  Cited 

Value  Engineering 
Negotiation  Workshop 
Conti  act  Placement 
Propeity  Management 
QAE  Coordination 


20  2 

3  ’  7 

4  6 


23  1 
2  8 
13  3 
13  3 


1  9 

2  8 
4  6 
1  9 
1  9 


Response: 


i 
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vi 
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IV.  Training  Courses  Perceived  Least  Beneficial 
Level  I  Courses 


Management  of  Defense  Acquisition  Contracts  -  Basic _ _ 10  1 

Operational  Contracting  Fundamentals _  _  3  4 

.  Principles  of  contract  Pricing  8  2 

_ Base  Level  Pricing _ _  _ _____  _  1  6 

jDefense  Cost  and  Price  Analysis/N egotiation  2  5 

Level  II  Courses 

Government  ConQactLaw  _ 10  1 

_ Intermediate  Pricing  _  _  _ 1  6 

Management  of  Defense  Acquisition  Contracts  -  Advanced  6  3 

Contract  Administration  -  Advanced  1  6 

Contract  Overhead  Management  1  6 

Level  III  courses 

Defense  Acquisition  Contracting  Executive  Seminar  _  16 

Management  of  Defense  Acquisition  contracts  -  Executive  2  5 

Others  Cited 

Value  Engineering  1.  6 

Negotiation  Workshop  1  6 

Contract  Placement  1  6 

Envoimmental  Contracting  1  6 
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Ranking 


Tabic  E-5.  Comments  to  Open  Ended  Questions 


I.  CERTIFICATION  PROGRAM  SATISFACTION  AND  IMPORTANCE 


1.0 
No. 
17244 
17289 
17293 
17298 
17340 
17459 
17684 
17691 
17702 
1 7739 


PROGRAM  IS  NEC  ESSARY  AND/OR  NEEDED 


-  s 


Demographics  Comments 

3  6  6  5  1  3  3  5  Certification  is  a  must. 

-4431632  It  has  been  needed  for  a  long  time. 

3  4  4  3  1  2  3  2  Essential 

4  4  4  1  16  3  4  Requited 

5  5  761447A  needed  instrument  to  improve  the  work  force. 
-4222632  Necessary  to  ensure  classes  are  attended. 
-5451744  Necessary  to  insure  a  professional  work  force. 

2  3  4  1  1  3  1  2  Needed  for  quite  some  time. 

--  5  44173  5  A  change  was  needed  and  its  better  than  before 

6  -  4  4  5  1  o  3  7  Necessary  requirements  to  meet  the  ever  changing  \va\  s 

wc  do  business 


2.0  P 
No. 

17214 
17220 
1 722.8 

17229 

1 7230 
17235 
17237 

1 7246 
i  7254 
17270 


17273 

17284 

17286 

17305 

17313 

17316 


4  - 


ROGRAM  IS  PERCEIVED  AS  HAVING  VALUE/WORTH 
Demographics  Comments 

-'-  4  3  7  7  2  1  3  1  Great. 

-  -  317  512  3  2  Good  idea. 

-  -  56451  53  5  Good  Idea 

-  -  2  4  4  1  12  12  Good  Program. 

-  -  4  4  5  1  1  6  3  1  I  am  happy  to  see  the  certification  program. 

-  -  44  7  1  1535  The  certification  program  is  an  excellent  idea 

-  -  2  4  3  1  1  2  3  2  It's  a  good  program.  I  don’t  believe  APDP  and  L)A\VL\ 

have  been  stressed  enough. 


-  -  44521  5  32  Program  has  good  intentions 

-  -  3  2  3  I  14  12  i  like  certification  iequueuienis 

-2-231  121  2  1  think  it's  a  good  program -- it  motivates  people  to  get  the 
coliege  classes  they  need  and  that  they  usually  have  wanted 
but  they  were  just  procrastinating.  Tins  gives  them  a 
little  "push." 

-  4-2  4  T  13  12  Very  Good 

-  -  3  4  2  V  I  2  1  2  Effective. 

4  -  -  5  4  4  1  1  3  7  Good. 

-4-344163  2  It  is  a  good  program  I  feel  everyone  who  meets  the 
requirements  is  qualified  for  a  certificate  or  warrnnl 

4  -  -  5  452744  The  program  is  basically  sound 

--  5  455143  4  I  agree  with  the  concept  of  a  certification  program 
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Tabic  E-5.  C  omments  to  Open  Ended  Questions  (Continued) 


17332 

6 

- 

- 

4 

4 

4 

i 

7 

4  7  Since  I  have  only  been  with  rite  Federal  Government  lor 

years,  it  is  tine  tor  me. 

17346 

1 

- 

- 

4 

1 

1 

i 

1 

1  3  It  is  well  structured. 

17473 

1 

- 

* 

6 

2 

4 

i 

7 

2  2  O.K. 

17485 

- 

3 

- 

A 

4 

4 

i 

6 

1  2  O.K. 

17493 

- 

3 

- 

4 

4 

6 

i 

3 

2  2  It’s  very  good. 

17499 

- 

4 

- 

4 

5 

7 

i 

3 

3  2  l  believe  it  is  a  better  program  than  the  skill  levels 

preciously  used. 

17566 

'"1 

- 

- 

4 

2 

1 

i 

3 

1  2  It’s  fine. 

17596 

- 

- 

i 

3 

7 

3 

i 

1  4  I  agree  with  the  certification  program. 

17615 

- 

- 

3 

5 

4 

1 

i 

6 

3  2  The  certification  is  a  good  grounding. 

17626 

3 

- 

- 

5 

4 

5 

2 

7 

3  2  It  is  a  well  focused  program. 

17628 

3 

- 

- 

5 

4 

4 

i 

7 

4  7  Overall  very  good 

1 7630 

4 

- 

- 

5 

4 

4 

“7 

/ 

3  5  1  am  satisfied  with  the  APDP  program 

17642 

- 

- 

7 

6 

7 

6 

i 

7 

4  1  Positive 

17644 

- 

** 

- 

7 

5 

i 

3 

2  1  Idea  is  good. 

17646 

- 

- 

4 

7 

6 

3 

i 

6 

3  2  Overall,  its  tine. 

17653 

- 

- 

5 

5 

6 

1 

i 

4 

4  3  O.K 

17655 

- 

- 

2 

4 

3 

1 

i 

3 

2  2  I  think  the  certification  program  is  an  excellent  idea 

17657 

7 

- 

- 

4 

1 

1 

i 

7 

1  2  Seems  adequate  and  well  balanced  between  the 

three  requirements 

17665 

- 

- 

5 

4 

5 

5 

i 

1 

4  3  A  very  good  idea  to  encourage  training  of  all 

personnel  and  education. 

1 7666 

- 

- 

4 

4 

4 

i 

i 

6 

3  3  Overall,  good. 

17667 

- 

- 

5 

6 

•7 

/ 

6 

7 

4  2  Good 

1 7683 

- 

- 

s 

5 

4 

5 

i 

1 

3  1  Good. 

17687 

5 

- 

- 

5 

4 

7 

i 

1 

3  2  Adequate 

17688 

- 

- 

-> 

7 

4 

I 

t 

7 

w  2  >  ihlilii  pi OgTaTTl  ii>  ^itdl. 

1 7698 

3 

* 

5 

7 

1 

i 

1 

2  1  O.K. 

17699 

- 

5 

- 

4 

6 

5 

i 

6 

3  2  A  very  worthwhile  program 

17721 

- 

- 

5 

5 

5 

2 

i 

4 

4  2  Good  tool,  much  further  ahead  than  other  services 

17740 

- 

- 

7 

4 

5 

i 

i 

7 

3  2  Certification  program  is  excellent. 

17768 

3 

- 

- 

6 

2 

i 

i 

1 

2  1  Good  -  sets  standards. 

3.0  PROGRAM  IS  A  GOOD  START  TOWARDS  A  PROFESSIONAL 

WORKFORCE 

No. 

Demographics 

Comments 

17237 

- 

- 

-s 

4 

“k 

y 

i 

i 

7 

3  2  It’s  a  positive  step  toward  a  well  named,  well  educated 

work  force  and  that  is  what  it  is  going  to  stay  competitiv 

;n  this  time  of  base  closures  and  downsizini: 

_ _  -n _ -  --  i  ■  ■ 


17256 


17274 

17318 

17535" 


17536 

17615 

17624’ 

17627' 

17643 


Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


2-221  12221  feel  that  the  APDP  certification  program  is  not  by  any 

stretch  of  the  imagination  perfect,  but  is  a  step  in  the  right 
direction 

4  -  4  5  5  1  6  3  2  It's  a  good  start  in  the  right  direction. 

-  -  4  1  1  1  3  1  2  The  program  is  definitely  headed  in  the  nght  direction 

5-4542736  A  process,  once  refined  that  will  enhance  the  ability  of 

government  procurement  individuals  to  protect  the 
government’s  interest  in  confidence. 

4-3531226  The  current  certification  program  is  only  the  first  draft 

-  3  5  4  1  1  6  3  2  It  is  a  step  rnthe  right  direction^ 

-  -  5  4  5  2  7  3  2  A  step  in  the  nght  direction. 

-5555  1632  It  is  a  step  in  the  nght  direction. 


17654 


17664  -  - 


17673 


17696 

17702 


17715  - 


3  1  2  2 
1  1  6  3 
5  2~7J3 
5  1  6  3 
5  1  2  4 


1  5  3 


1  7  3 


2  7  4 
17  3 


1  2  2 


1  I  view  it  as  a  significant  part  of  what  is  needed  to  ensure 
a  professional  work  force  capable  of  providing  effective 
customer  support  It  is  not  the  complete  answer 

4  It  is  a  good  stait  by  at  least  having  certain  requirements, 
some  seem  low,  but  maybe  in  the  future  they  can  be  raised 

2  One  small  step  for  contracting  in  one  giant  bureaucratic 
nightmare. 

5  Good  start  towards  professional  development  of  the 
acquisition  corps. 

7  Positive  step  to  escalate  acquisition. 

5  Through  people’s  input  the  system  can  be  "fine  tuned"  as 
we  go  along  to  better  prepare  individuals  for  a  professional 
work  force. 

5  I  do  not  believe  it  has  all  the  "bugs"  worked  oui  yet.  ]t  seems 
that  every-  base  is  getting  different  information  to  the  workers 


4.0  PROGRAM  IS  MEETING  THE  GOAL  TO  IMPROVE  THE  WORKFORCE 


No. 

17220 

17221 
17235 

17243 

17273 


Demographics 

-  -  3  17  5  1 
--  4  5  4  1  1 

-  -  4  4  7  1  1 


1  6_3 
f  5  3 


Comments 

2  Improving  the  professionals  of  the  work  force 

3  Improving  the  professionals  of  the  work  force. 

5  It  will  provide  educated  cxpenenced  and  well  trained 
contracting  and  acquisition  representatives. 

4  The  certification  is  important  in  maintaining  a  high  standard 
of  professionalism  for  contracting  personnel. 

2  By  setting  minimum  requirements  to  be  certified,  you  have 
a  more  educated  and  experienced  person  making  better 
decisions  They  are  also  better  qualified  to  guide  younger, 
less  experienced  contracting  personnel  in  the  rich!  direction 
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Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


6.0  IMPORTANCE  OF  THE  CERTIFICATION  PROGRAM  STANDARDS 


No. 

1 7311 

17313 


17464 


17625 


17657 


1 7 699 


6.1  I\ 

No. 

17238' 

17260' 

17265' 

17281 

17298 

17299 


17302 


17309 


17340 


Demographics 

-’-52  o  7  2 


-5  -  4  6 


1PORTANC 
Demograph 
--  4  6  6; 


Comments 

3  Training  and  experience  should  be  at  the  heart  of  any 
certification  program 

4  Training  and  expenence  are,  in  my  estimation,  co-equais. 
They  are  both  needed  to  make  the  whole  contracting 
professional.  Though  training  was  selected  as  most 
important  for  item  15,  expenence  could  have  also  been  my 
choice.  _ 

2  In  reality,  all  three  elements  are  needed  to  ensure  a  quality 
work  force.  Each  element  contnbutes  to  the  knowledge 
needed. 

4  While  selecting  experience  as  most  important.  1  feel  training 
and  education  are  equally  important. 

2  1  think  that  someone  just  getting  into  the  acquisition  field 
should  already  meet  the  education  requirements,  and  have 
taken  the  necessary  training  courses  prior  to  actual 
expenence 

1  I  would  rank  the  elements  as  expenence,  education  then 
training 


EXPERIENCE 

Comments 

3  1  There  is  no  replacement  for  expenence.  Experience 
contains  knowledge  not  achievable  in  the  classroom. 

1  2  I  feel  experience  is  the  greatest  factor  in  job  proficiency 
1  2  People  learn  more  from  experience  and  "on-hands" 
learning 

1  2  It  should  be  centered  more  around  experience. 

3  4  Expenence  is  by  doing,  not  from  a  book 

3  7  It  is  less  important  to  be  career  broadened  ("pogoing"  a  few 

monthshere  and  a  few  months  there)  than  it  is  to  dig  in,  spend 
tune  and  really  learn  a  particular  area  and  then  move  on 

4  1  Expenence  out_  weights  most  degree  programs,  particularly 

when  those  degrees  were  achieved  with  very  low  GPAs. 

4  3  Hands-on  expenence  is  the  only  way  to  develop 
contracting  skills 

4  7  Longer  “hands-on”  expenence  for  each  trainee. 
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Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


17494 


17522 
1 7530 


1 7544 

1 7622 
1763$ 
1  7o3'.J 
1 7643 

1765$ 

17665 


!  7699 
1 7700 
17722 


-  3 


3 
3  2 


-  5 
-6 

-  s 

-  7 

-  1 


3  1 
7  2 


2  1 


2  4  1  1  2  3  3  1  believe  experience  is  extremely  important  role  A  two 

year  SSgt  cross  trainee  does  not  have  the  same  knowledge 
experience  and  probably  can  not  handle  difficult  acquisitions 
as  a  5  to  10  year  experienced  SSgt 

Should  be  equally  weighed  between  training  and  expenence. 
Too  easily  training  certification  surpasses  experience  and 
leave  a  void  in  job  knowledge  really  needed  College  isn't  as 
important  as  currently  weighted  and  experience  should  be 
more,  there  should  he  a  leveling  off  between  the  two 
2  New  ideas  are  good  but.  job  experience  and  know  how 
are  much  more  important. 

2  Expenence  and  mobility  are  the  keys. 

2  7  I  believe  experience  is  the  most  important  teacher 

5  4  7  Experience  is  \vhat  makes  a  good  contracting  person 
2  4  1  Quality  of  expenence.  quality  of  the  individual,  regardless 
of  whether  they  have  attained  certification  are  keys. 
Frequently  the  expertise  required  at  the  operational  level  is 
above  that  achieved. 

These  are  anras  that  need  to  be  emphasized  but  experience 
is  the  most  important  factor.  You  can  have  a  degree  and 
all  kinds  of  courses,  but  without  the  hours  of  experience  you 
can't  be  very  knowledgeable  or  effective 
You  cannot  under  estimate  experience  front  the  ground  up. 
working  in  the  trenches 

Experience  should  cany  more  weight  than  degree 
requirements 

7  Training  and  most  certainly  education  can't  take  the  place 
of  experience. 


7  5  1 


6.2  IMPORTANCE  OF  TRAINING 


No.  Demographics 


12292 


17464 


1 7544 


4  4  4  11 


Comments 

1  Required  courses  are  adequate  in  subject  and  number  for  the 
certification  program 

Training  is  the  way  to  improve  the  work  force.  The  more 
knowledge  you  have,  the  better  able  you  will  be  abje  to  apply 
the  principles  in  the  work  force 
Job  training  is  so  much  more  important  than  a  masters 
degree  in  education  or  basket  weaving  Tram  the  people  who 
are  in  the  jobs  now. 
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Tabic  E-5.  Comments  to  Open  Ended  Questions  (Continued) 

1 7553  •  -  1  4  3  3  1  2  2  2  I  think  training  is  the  most  imponant  due  to  the  fact  that  the 

contractors  know  more  than  the  government  employees 
government  employees. 

17621  -  -  3  4  4  1  1  1  3  2  With  the  downsizing  of  the  AF.  experience  is  being  lost. 

Training  is  becoming  more  imponant. 

1 7645  -  5-  3331622  Provides  good  training. 

17699  -  5-  4651632  AF  training  is  the  best  I  am  an  advocate  of  training  and 

send  my  subordinates  when  1  can. 


6.3  IMPORTANCE  OF  EDUCATION 

No.  Demographies  Comments 

1 7244  -  -36651335  Education  requirement  is  very'  entical  to  ensunng  that 

new  employees,  as  well  as  current,  are  well  qualified 

1726i)  -  -  2  1  4  5  1  2  1  2  Too  much  emphasis  on  education  ai  the  lower  levels 

17493  -  3  -  4  4  6  1  3  2  2  The  overall  education  is  very  important  in  bringing 

protessionalism  to  the  career  field 

17651  -  -  2  4  3  1  12  1  2  If  we  have  a  strong  education  background,  we  easily 

grasp  new  materials  and  complete  the  required  training  to 
become  an  empowered  work  force. 

i  7664  -  -  4  5  4  1  1  5  3  2  No  way  to  incentives  education 

17705  -  -  4  2  7  2  1  1  3  6  1  feel  it  helps  personnel  with  a  degree,  but  does  not  help 

those  without  a  degree. 

17553  -  -  1  4  3  3  1  2  2  2  I  think  training  is  the  most  important  due  to  the  fact  that  the 

contractors  know  more  than  the  government  employees 
government  employees 

17621  -  -  3  4  4  1  1  1  3  2  With  the  downsizing  of  the  AF,  experience  is  being  lost 

Training  is  becoming  more  important. 

!7o45  -  5  -  3  3  3  1  6  2  2  Provides  good  training. 

1 7699  -  5-  4651  632  AF  training  is  the  best.  1  am  an  advocate  of  training  and 

send  my  subordinates  when  1  can 
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Table  E-5.  Comments  to  Open, Ended  Questions  (Continued) 


II.  CERTIFICATION  PROGRAM  DISSATISFACTION  AND  CONCERNS 


1.0  PROGRAM  IS  MEANLNGLESS/UNIiYlPORTANT 


No.  Demographics 


17219  - 


17234  - 


t  - 


17264 


1 7301 
17311 


1  /J  18 

1 7435 

1 7544 
17571 

17615 

17619 
17623  ' 


17633 
1 7636  | 
17639 

1 7662 

17663 
17682 


-  4  4 


-  s 


1  1 


Comments 

4  People  are  'Tilling  blocks,"  getting  certification  but  don't 
understand  the  job. 

3  Nothing  more  than  another  block  to  check  off 
It  has  gotten  to  the  point  were  a  certification  is  no  more 
meaningful  than  a  high  school  diploma.  Put  in  the  time, 
attend  the  courses  and  you'll  receive  your  certification. 

2  There  are  many  excellent  contracting  specialists  who  have 
have  been  doing  outstanding  work  before  the  certification 
program,  which  proves  certification  programs  are  not 
necessary  to  make  a  person  a  person  a  gevd  buyer 
2  7  4  7  Doesn't  mean  anything.  Requirements  are  too  easy  to  meet 
6  4  3  Hang  on  the  wall  decoration,  check-off,  fill  the  square  item 
Just  another  piece  of  paper  program  that  means  nothing 
to  those  ouf.ide  of  contracting. 

Obtaining  a  level  1  certification  really  does  not  mean 
anything. 

2  Seems  as  though  certifications  arc  given  out  rather  than 
earned. 

As  a  joke. 

0  While  I  agree  with  questions  1 1  -1 4. 1  do  not  believe  the 
certification  of  the  people  1  work  with  makes  a  difference. 

If  i  go  for  the  level  three,  will  this  certification  mean 
anything  in  1 0  years  ’ 

Inconsequent ia! .  (Tcrtilicstion  is  unimportunl. 

It  appears  the  certification  program  parallels  w'hat  the 
contracting  community  was  already  doing  in  the  area  of 
training  and  education  (so  no  change.) 

Another  square  to  fill. 

Another  square  to  fill. 

As  a  "block  checking"  exercise. 

Just  filling  the  blocks. 

Just  another  block  to  check 

The  goal  of  a  stable  well  educated  professional  work  force 
with  level  1.  11  and  III  certifications  must  have  some  reward 
system  tied  to  it  that  is  both  meaningful  and  realistic,  k  illing 
the  squares  with  certifications  just  won’t  do  it 
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Table  E-5.  Comjnents  to  Open  Ended  Questions  (Continued) 


2.0  PROGRAM  IS  NOT  MEETING  ITS  INTENDED  PURPOSE 


Demographics  Comments 

-5474  1233  Sounds  great  on  paper  by  not  realistic 
-44741  637Asnot  serving  the  purpose  tor  which  it  is  intended 
-44521532  Appears  to  usurp  an  individual  managers  judgment  when 
hiring  or  filing  slots. 

-43641742  The  certification  program  and  various  intern  programs 

are  good  but  do  not  provide  a  professional  work  force.  Too 
many  people  are  in  the  work  force  who  are  well  mtentioned 
but  are  not  as  well  informed  as  they  might  think. 

4  -  2  4  1  1  6  2  2  DAWLA  seems  to  be  a  '’knee-jerk"  reaction  to  criticism. 

One  sided,  caters  to  systems  contracting  requirements  and 
ignores  operation  base  level  peculiarities.  Requires  base 
level  personnel,  specifically  enlisted,  to  learn  concepts 
without  any  real  opportunity  co  apply  that  knowledge  1  teel 
there  should  be  a  duel  certification  system.  One  designed 
for  systems  level  acquisition  and  the  other  base  level  activities. 
Most  of  the  systems  related  concepts  are  never  used  by 
operational  activities  or  forgotten  before  the  opportunity 
arises  for  their  application. 

-45621  322  Those  who  operate  these  programs  and  provide 

certifications  don't  have  a  clue  what  actually  goes  on  at  ihe 
desk  level,  i.e..  the  problems  which  are  "real."  Entil  people 
at  the  problems  level  get  heard  and  are  given  some  power 
to  find  and  implement  solutions,  your  programs  arc  useless 
for  readiness,  but  you'll  fee.  good  about  them,  that  is  all 
that  is  ensured. 

4-3531222  An  unrealistic  way  of  trying  to  professionalize  the  field 
3  -  3  1  3  2  7  3  6  Program  is  not  realistic  and  puts  emphasis  on  system  ievei 
not  operational. 

-  3  3  5  1  1  1  3  2  Its  intended  purpose  has  gone  by  the  wayside 
•5  4  5  5  1  5  4  7  The  idea  behind  it  is  good,  but  in  implementation  the 
attitude  seems  to  be  "get  it  done  push  'em  through." 
4-4251  2  121  am  not  sure  if  a  great  deal  of  thought,  on  an  individual 
basis,  goes  into  achieving  the  certifications  People  I  deal 
with  want  the  certification  for  reasons  that  have  nothing  to 
to  do  with  increasing  their  proficiency  Its  been  mandated 
that  they  get  certitied  and  to  piotect  then  careers,  ihev  gel 
certified 


17249 

17299 

17246 

17247 


5  4  7 


-  -  4 
--4 


17255  -  4  -  2  4 


-  -  4  5  6  2  1  3 


-  4  -  3  5  3  1  2 


1 7523 
17532 

i  7560 
17639 


17766  -4-4251 
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Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


3.0  PROGRAM  IS  A  YVASTE  OF  RESOURCES 
No.  Demographics  Comments 

1 7247  --43641742  The  government  is  losing  big  bucks. 

17255  -  4  -  2  4  1  16  2  2  Training,  unless  focused  is  largely  a  waste  of  resources. 

17296  -  -  4  5  6  2  1  3  2  2  It  is  a  waste  of  time  and  resources.  These  certification 

programs  are  almost  as  wasteful  as  DOD's  TQM  program 
17309  -  -  5  4  6  5  1  2  4  3  Waste  of  time. 

17681  -  -5552  1  1  3  1  Waste  ofTime. 


4.0  PROGRAM  KEEPS  CHANGING 

No.  Demographics  Comments 

17214  -  -43772131  Be  consistent  -  true  changes  are  necessary,  however 

constant  changes  arc  unnecessary 

17457  1  -  -  4  1  I  1  3  1  2  The  requirements  keep  changing,  which  makes  it  that 

much  harder  for  an  individual  to  become  certified, 
especially  when  classes  are  so  hard  to  get. 

17571  -  -  2  2  4  3  1  2  3  2  It  keeps  changing,  the  requirements,  the  classes,  the 

grandfathering  -  How's  on  earth  can  it  be  effective  with 
ail  the  changes. 

17614  --  34432  1  3  2  Don't  keep  changing  it,  it  devalues  the  system 

5.0  PROGRAM  DOES  NOT  REFLECT  ABILITY  TO  PERFORM  THE  JOB 

No.  Demographics  Comments 

17230  -  -  4  4  5  1  1  6  3  1  One’s  experience  or  education  are  not  necessarily  indicative 

on  one’s  motivation  to  provide  effective  customer  support 

17234  -  -24431  133  It  is  no  measure  of  contracting  knowledge,  aptitude  or 

application,  everyone  gets  one.  regardless. 

17238  -  -  4  6  6  1  1  5  3  !  A  person  can  achieve  a!!  the  training  education  opportunities 

afforded  to  an  individual,  however,  be  lacking  in  the  real 
life  lessons  learned  through  experience 

1 7249_  --54741233  While  training  and  education  are  valuable,  1  have  observed 

they  often  give  us  educated  idiots  incapable  of  functioning 
in  the  governments  bureaucracy. 

17265  -  2-  2231212  1  don’t  see  how  this  is  going  to  make  people  know  their 

job  better. 

17332  6--4  4  4  1  2  4  7  I  think  there  may  be  loo  much  rigidity  and  a  failure  to  look 
.  at  practical  experience  and  application 
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Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


5.1  HIGHER  EDUCATION  DOES  NOT  EQUATE  TO  ABILITY  TO 
PERFORM  THE  JOB 


No. 

17261 


Demographics 


17312 


17544  - 


17560  - 


1 7638  - 


17639  - 


17643  - 


Comments 

2  There  is  no  possible  advancement  unless  you  meet  the 
certification  requirements  and  I  wonder  what  that  does  to 
the  motivation  of  good,  experienced  employees  that  don't 
meet  the  educational  requirements. 

2  Classes  in  business  are  not  essential  to  being  a  successful 
contract  negotiator/PCO.  In  fact,  best  negotiators, PC  Os 
I've  seen  and  worked  with  have  degrees  in  areas  other  than 
business. 

3  I  have  supervised  persons  with  a  lessor  amount  of 
experience,  and  they  are  generally  less  prepared  to  perform 
unless  assisted. 

2  There  are  more  educated  dummies  coming  out  of  this 
certification  program  than  imaginable.  Just  because  you 
have  an  education  does  not  mean  you  are  qualified  for  one 
ot  these  jobs.  Not  the  ones  who  play  the  education  game. 

2  We  have  all  these  educated  idiots  with  no  practicable 
experience.  If  circumstances  preclude  you  from  getting 
your  24/36  hours  you  are  not  prornoteohle.  but  yet  you  max- 
have  20  <-  years  of  experience. 

2  Some  with  PI  IDs  couldn’t  award  a  purchase  order  yet  the\ 
are  the  ones  that  advance. 

7  To  exclude  personnel  who  have  proven  their  ability  on  a 
.day  to  da}'  basis  by  denying  them  certain  jobs  because  of 
Jack  of  a  degree,  is  ridicules. 

7  We  have  plenty  of  contracting  officers  with  masters 
degrees  and  only  2-3  years  in  the  field  who  wouldn’t  know 
a  sound  business  decision  if  it  struck  them  in  the  face. 

1  1  believe  that  there  are  many  individuals  without  formal 
college  courses  or  degrees  in  other  than  business  who  are 
are  outstanding  contracts  people.  I  think  the  degree/ 
business  requirements  in  the  certification  requirements  are 
short  sighted  in  that  respect. 


Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


17646 


-  4 


6  3  16  3 


17647 


17682  - 


17688 

17709 


6.0  P 

No. 

17220 

17284 

17485 

17534 


2  As  someone  with  1 8  years  contracting  experience  and 
little  college.  1  feel  like  DOD  is  de-valuing  my  worth  as  a 
a  productive  and  useful  employee.  No  amount  of  education 
can  equal  experience  on  thejob.  To  require  college 
education  in  today's  environment  (where  college  is  the  rule 
rather  than  the  exception)  is  fine.  But  to  insist  that  those 
with  expenence  need  to  go  back  and  gel  it  makes  no  sense, 
and  worse,  suggest  we  should  have  to  take  a  test  to  prove 
our  contracting  abilities  when  we  have  been  doing  thejob 
all  these  years  -  what  purpose  does  a  test  serve  at  this 
point? 

2  It  seems  it  doesn't  matter  how  much  expenence  you  have 
or  what  your  appraisal  rating  is  as  long  as  you  have  a  piece 
of  paper  stating  you  have  a  college  education. 

-  5  6  6  5  1  0  4  7  The  original  goal  of  a  masters  degree  or  higher  made  Al' 
funded  training  for  masters  degrees,  but  work  didn't 
improve,  only  the  attitude  that  now  these  people  should  be 
be  promoted  to  higher  positions  without  expenence. 

2  IGy  expenence  has  been  vital  to  the  mission  but  iny  lack  ot 
a  degree  does  not  mean  I  am  not  teachable  or  promoteable. 
There  are  many  employees  who  currently  possess  up  to 
twenty  years  in  contracting  experience  who  lack  a 
bachelors  degree.  These  people  have  the  qualifications  to 
do  thejob.  however,  due  to  the  fact  that  they  don't  have  a 
degree,  they  are  being  hindered  from  further  promotion 
(beyond  GS-1 2)  1  am  not  advocating  not  pursuing  a 
college  degree,  however.  I  think  in  this  situation  everyone 
loses,  the  muiv  idua!  and  the  AT  It  might  be  a  gOou  idea  to 
further  incentivize  the  work  force  by  establishing  GS  1 2. 1 3 
training  positions  for  those  in  pursuit  of  masters  degrees 


ROGR 
Demographics 

3 


AM  STANDARDS  ARE  TOO  LOW 
Comments 

7  5  1  2  3  2  Not  enough  expenence  and  training. 

2  112  12  Should  require  more  training  and  education 

4  4  16  12  Levels  for  expenence,  training  and  education  are  too  lenient. 

5  2  1  7  3  6  Standards  are  too  k.w. 
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Tabic  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


7537  -  3  -  4  3  1  1  7 


17625 

17675 

17678 

17682 


4  - 


17723  -  - 


17729  - 


17731  4 


6.1  EXP  ERIE 
No.  Demogra 

172.56'- 

17274  - 


17298 

17299 


17310  - 


17311 


17313 


2  7 
6 


1  6  I  have  heard  many  people  say  the  majority  of  the 
contracting  personnel  will  never  see  the  level  3 
certification.  It'  this  is  the  case,  I  suggest  the  criteria  to 
obtain  this  level  be  changed  to  1 0  years  in  the  experience 
area  and  a  masters  degree  in  the  education  area. 

4  The  current  requirements  are  to  weak.  More  should  be 
required  for  each  certification  level. 

4_The  old  certification  program  was  a  better  program  due  to 
more  stringent  requirements. 

4  3  Not  strong  enough,  especially  at  level  IQ. 

4  7  SAF/AQ  has  put  its  mark  on  this  program  and  then  opted 
for  mediocrity  by  giving  in  to  the  years  of  expenenee  and 
educational  criteria. 

1  It  has  been  diluted  recently  with  the  deletion  of  M  ine  of 
the  onginal  requirements  The  certification  does  not  mean 
as  much  as  it  originally  did. 

2  Maintain  the  high  standards  or  the  whole  process  becomes 
meaningless. 

5  I  believe  people  from  other  career  fields  can  become  very 
competent  in  contracting  with  the  proper  training  in  the  tune 
frame  currently  established 


NCE  REQUIREMENTS  ARE  TOO  LOW 
phics  Comments 

2  1  1  2  2  2  1  feel  more  emphasis  should  be  pul  on  lime  experience  and 
position  held  experience 

2  1  thought  the  AF  was  absolutely  right  with  their  initial 
requirement  of  2:4, &  years  experience.  Many  people  in 
our  field  fume  one  year  experience.  4  times. 

4  1  1  6  3  4  More  time  (experience)  is  needed. 

7  4  1  6  3  7  Contract  specialists  should  serve  at  least  two  years  in  each 
grade  before  advancing  to  the  next  grade. 

3  Was  OK  until  AE  relaxed  the  expenenee  levels  to  4  years 
Four  years  is  not  enough  to  build  a  basis  for  good  judgment 
decisions  by  senior  managers/squadron  commanders. 

3  Expenenee  requirements  should  be  lengthened  to  2,  4  and 
1 0  years  for  levels,  respectively.  Breadth  of  experience 
should  also  be  addressed 

4  4  1  feel  8-10  years  of  contracting-acquisition  experience 
should  be  a  prerequisite  for  level  III  certification 
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Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 

V  ill  -  -  HI  JUJ  i—  ^  . . . .  ,  ■  .  .  --  -  —  ■  - - 

17316  -  -  5  4  5  5  1  4  3  4  I  disagree  with  the  current  certification  experience 

requirements  tor  level  I  and  D.  At  the  very  least  these 
levels  should  be  raised  by  one  year 

173 176  -  -  576274  4  Need  to  return  expen  ence  requirements  back  to  1/4/ S 

years  respectively. 

17330  -  -  32531233  Experience  should  be  raised  to  more  number  of  years  as  it 

takes  more  than  4  years  to  be  proficient  in  an  executive 
position. 

1 7459  2  -  -  42226  3  2  More  expenence  requirements  should  be  included. 

1 7494  -  3-  241  1233  The  expenence  should  be  increased. 

1 7497  1  -  -  4  1  2  1  2  1  2  I  don’t  like  the  recent  change  in  the  number  of  years  of 

expenence  required,  especially  at  the  level  2  and  3. 

1 7499  -  4  -4521  332  The  expenence  requirements  are  too  lax. 

jl753i>  -  4  -  3  5  31  2  2  6  The  expenence  levels  changed  i.e.  if  you’ve  gone  to  5 

schools  in  2  years  to  get  level  D  certification  -  you  have  the 
schools  but  no  real  expenence  because  you've  been  in 
school  and  that  is  not  expenence. 

1 7560  -  -  3  3  5  1  1  1  3  2  I’m  for  improving  yourself  but  expenence  in  the  APDP 

arena  doesn’t  account  for  enough  any  more. 

17611  -  -  4441  1  1  3  1  To  obtain  a  higher  degree  of  knowledge,  the  experience 

level  nun  her  of  years  is  far  too  low.  Although  the  training 
and  education  is  of  great  importance,  without  proper 
application  a  high  degree  of  knowledge  and  expertise  cannot 
possible  be  obtained. 

17623  5  -  -  5  5  6  2  7  4  6  In  the  area  of  experience  the  requirements  tire  almost 

laughable  I  don't  know  why  we  need  requirements  for 
expenence  if  they  are  going  to  be  so  easily  attained  They 
certainly  don't  provide  the  comfort  zone  in  ones  abilities 
that  one  would  expect  from  a  certification  program. 

Raise  Them1 

17625  -  -  5576124  4  The  2  and  4  years  expenence  to  be  a  level  II  and  level  Ill 

are  totally  inadequate. 

17627  -  -5555163  2  More  stnngent  expenence  requirements  for  GS-9  and 

above  should  be  required. 

17630  4  --544  2  735  I  believe  the  AF  standards  for  expenence,  2/4/8  years 

were  smart.  I  believe  that  DOD  rules  of  1/2/4  years  are 
too  easy  In  this  complex  career  arena,  4  years  can't  be 
enough  to  qualify  someone  as  an  "expert.” 
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17634  4  -  - 


1763S 


17639 


1  7642 
1 7666 
17678 


-  -  7 

-  -  4 
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1 7228 


17229 

17236 

17302 


Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


6  4  6  2  7  4  2  It  is  weak  because  the  experience  lime  is  too  short  Level 
D  certification  should  be  changed  to  6  years  and  at  least 
two  different  contracting  jobs.  Let  el  ill,  ten  tears  and  at 
least  3  different  contracting  positions. 

4  7  5  12  4  7  I  think  the  number  of  years  required  is  too  short  a  period  to 
achieve  a  quality  mission  ready  work  force  This  is  due  to 
the  length  of  time  required  in  the  contracting  process  itself 
4  5  5  1  5  4  7  Level  II  contracting  officers  with  2  years  expenence,  this 
is  a  joke.  You  CAN  NOT  learn  contracting  in  2  years. 

You  will  not  be  a  good  contracting  person  in  4  years 
These  minimal  experience  requirements  are  obviously  set 
so  that  management  can  continue  to  promote  their  favorites 
in  the  face  of  ineffective  certification  requirements. 

6  7  6  1  2  4  1  The  experience  levels  are  not  long  enough 

4  4  1  1  6  3  3  Expenence  requirements  should  be  higher 

6  6  5  2  7  4  3  More  years  experience  for  level  D  and  ED 

Currently  we  have  situations  where  inexperienced  people 
are  holding  director/division  positions. 

5  1  2  2  7  3  4  Expenence  requirements  (2/4/8  yrs)  was  appropnate  until  it 

was  reduced  to  meet  Army  standards  (L  2/4).  Now  level 
II  lost  it's  prestige 


CATION  R 
■mographics 

-  5  6  4  5  1 


IREMENTS  ARE  TOO  LOW 
Comments 

5  Need  more  focus  and  increased  requirements  on  college 
graduate  education  -  specifically  in  the  area  of  business 
and  financial  management.  Need  more  financial  and  asset 
management  locus.  Need  more  financial  and  asset 
management  focus 
2  Require  a  BS.BA  4  year  degree. 

2  Masters  level  degree  for  management  positions 
1  Although  attempting  to  qualify  members  of  the  contracting 
community  as  a  professional  body,  I  do  not  believe  that  the 
educational  requirements  support  that  designation  with  a 
requirement  of  24  hours  of  business  courses  or  any  degree. 
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Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


17313 


17317 

17491 

1  7443 


17615 

17625 


6  - 

-1 


17667 

17678 

17694 


7.0  ENLISTED  CONCERNS  ABOLT  THE  CERTIFICATION  PROGRAM 


No. 

1 7493 


17536 


17537 


6  1 


4  4  Regarding  education,  I  feel  a  degree  is  essential  to  keep 
the  "Certified  Acquisition  Professional"  tag  from  being 
hollow.  Granted  it  was  prudent  to  grandfather  some  of  our 
folks,  from  that  point  on,  degrees  should  be  mandatory  for 
any  not  covered  under  the  initial  "GF."  Specifically,  the 
degree  should  be  in  business,  accounting  or  contract 
management. 

If  we  really  want  to  be  a  professional  work  force,  need  to 
to  make  a  degree  mandatory 
It  does  not  provide  any  compensation  for  your 
achievements  and  extra  schooling  you  have  obtained. 

I  think  you  should  have  at  least  a  bachelors  degree  in 
Business  or  a  related  area  to  come  into  contracting, 

I  feel  that  higher  levels  of  certification  should  be 
accompanied  bv  a  BA  not  just  24  hours  of  business 
courses. 


Demographics 


3-446 


2  Education  requirements  should  be  more  strict. 

4  Requirements  of  a  Bachelors  degree  would  appear  more 
appropriate,  if  not,  at  least  an  Associates  degree  related 
to  business. 

Should  required  a  degree. 

3  A  level  three  should  have  a  degree, 

I  believe  the  education  requirements  should  become  more 
stringent  with  increasing  ceilification  levels. 


Comments 

2  Contingency  contracting  training  is  essential  to  base  level 
or  operational  contracting.  Most  members  are  inept  when 
it  come  to  functioning  in  the  true  aspects  of  the  mission 
The  current  certification  program  does  not  match  up 
with  enlisted  OJT  requirements.  Programs  need  to 
to  compliment  each  other  in  lieu  of  hinder  on  another  i.e., 
what  I  need  to  get  my  7-level  upgrade  has  nothing  to  do  with 
my  certification  requirements 

Enlisted  members  should  not  be  excluded  from  working  m 
systems  command  or  material  command  By  allowing 
enlisted  contracting  members  to  work  at  any  and  all 
commands  that  the  AF  has  to  offer,  a  mission  ready 
professional  work  force  is  within  reach _ 
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Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


17497  1 


17503 


17523 

17560 

17615 


17624  3 


17630 


17634 
17651 
1 7675 


17682 


17683 


1 7702 
17630 


-  4 


12  12  12 


-  5  4 


-  5  4  5 


5  4 


1  6 


1  3 


l  7  3 


2  7  3 


Once  again  the  AF  doesn't  stick  with  a  program  because 
there  are  not  enough  trained  people  to  fill  the  slots  Keep 
the  pilots  out. 

I  believe  it  :s  a  way  to  keep  from  promoting  those 
employees  that  have  given  their  time  and  energy  on  the 
job  and  not  in  college 

Revise  certification  within  contracting,  i  e .  operational 
command,  etc. 

3  2  Over  done  to  an  extent. 

It  is  not  very  well  understood  by  employees  and  personnel 
offices.  It  doesn't  specialize  enough  in  the  types  of  contracts 
we  use. 

7  3  2  Needs  to  go  further,  professionalize  it  completely  with 

appropriate  grade  structure  to  back  n  up  bn  listed,  c:\dian. 
and  officers  are  required  to  march  to  a  higher  standard  in 
the  acquisition  field,  compensate  them  accordingly 
5  I  believe  that  everyone  should  be  required  to  apply  every 
certification  level,  i.e.,  not  skip  levels  based  on  their  current 
number  ot  years  ol  experience. 

2  Certification  levels  should  be  something  to  really  strive  for 
2  The  certification  program  should  be  enforced  continuously 
4  To  have  a  mission  ready  work  force,  we  need  more  military 
in  the  career  field  with  a  better  "path  to  achievement."  just 
like  pilots.  A  professional  corps  should  be  maintained  without 
rated  sups  coming  in  as  the  division  chief. 

7  It  is  the  only  current  means  to  identify  personnel  that 
desire  to  seek  professional  status  through  self-motivated 
external  training,  but  falls  short.  Certification  won't  make 
our  jobs  easier  when  we  have  less  human  resources  to  do 
this  job  Without  recertification  or  proficiency  testing,  once 
certified  your  a  "lifer.” 

With  the  on-set  oflPTs.  the  PCO/ACO  and  PM  should 
be  merged  at  the  executive  level  to  ensure  a  proper  team 
arrangement.  I  think  a  PCO  should  be  certified  as  an  ACO 
and  vise  versa.  There  should  be  a  recertification  process, 
eg,  a  one  day  seminar 

Presently,  1  don’t  think  enough  time  has  elapsed  to  assess 
what  is  in  place 

1  believe  that  everyone  should  be  required  to  apply  every 
certification  level,  i  e  .  not  skip  levels  based  on  their  current 
number  of  years  of  experience _ 
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17497 


7503 


1 7523 

17560 

17615 


17624 


17630 


1 7634 
17651 
1 7675 


7682 


17683 


1  - 


17702 


17630  4 


-  s 


12  12  12 


2  1 
7  3 


Once  again  the  AF  doesn't  stick  with  a  program  because 
there  are  not  enough  trained  people  to  lill  the  slots.  Keep 
the  pilots  out. 

I  believe  it  is  a  way  to  keep  from  promoting  those 
employees  that  have  given  their  tune  and  energy  on  the 
job  and  not  in  college 

Revise  certification  within  contiaeting.  i.e.,  operational 
command,  etc 
Over  done  to  an  extent. 

It  is  not  very  well  understood  by  employees  and  personnel 
offices.  It  doesn't  specialize  enough  m  the  types  of  contracts 
we  use 

2  Meeds  to  go  further,  piolessionalize  it  completely  with 
appropriate  grade  structure  to  buck  it  up.  Enlisted.  c;\  iii.i:t. 
and  officers  are  required  to  march  to  a  higher  standard  m 
the  acquisition  field,  compensate  them  accordingly 

5  1  believe  that  everyone  should  be  required  to  apply  every 
certification  level,  i.e..  not  skip  levels  based  on  their  current 
number  of  vears  of  experience 

2  Certification  levels  should  be  something  to  really  strive  for 

2  The  certification  program  should  be  enforced  continuously 

4  To  have  a  mission  ready  work  force,  we  need  more  military 
in  ihe  career  field  with  a  better  "path  to  achievement."  just 
like  pilots.  A  professional  corps  should  be  maintained  without 
rated  sups  coming  in  as  the  division  chief. 

It  is  ihe  only  current  means  to  identify  personnel  that 

desire  to  seek  professional  status  through  self-motivated 
external  training,  but  falls  short  Certification  won't  make 
our  jobs  easier  when  we  have  iess  human  resources  to  do 
this  job.  Without  recertification  or  proficiency  testing,  once 
certified,  your  a  "lifer." 

1  With  the  on-set  of  IPTs,  the  PCO/ACO  and  PM  should 
be  merged  at  the  executive  level  to  ensure  a  proper  team 
arrangement.  I  think  a  PCO  should  be  certified  as  an  ACO 
and  vise  versa.  There  should  be  a  recertification  process, 
e.g  ,  a  one  day  seminar. 

5  Presently,  1  don't  think  enough  time  has  elapsed  to  assess 
what  is  in  place 

5  1  believe  that  everyone  should  be  required  to  apply  every 
certification  level,  l  e  .  not  skip  levels  based  on  their  current 

_ number  of  years  of  experience _ 
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Table  Ii-5.  Comments  to  Open  Ended  Questions  (Continued) 

17634  4  -  -  6  4  6  2742  Certification  levels  should  be  something  to  really  strive  Tor 

17651  -  -  2  4  3  1  1  2  1  2  The  certification  program  should  be  enforced  continuously. 

17675  4-  -  54527  3  4  To  have  a  mission  ready  work  force,  we  need  more  military 

in  the  career  field  with  a  better  "path  to  achievement."  just 
like  pilots.  A  professional  corps  should  be  maintained  without 
rated  sups  coming  in  as  the  division  chief 

1 7682  -  -  5  6  6  5  1  6  4  7  It  is  the  only  current  means  to  identify  personnel  that 

desire  to  seek  professional  status  through  self-motivated 
external  training,  but  falls  short  Certification  won't  make 
our  jobs  easier  when  we  have  less  human  resources  to  do 
this  job  Without  recertification  or  proficiency  testing,  once 
certified,  your  a  "liter  ” 

17683  -  -  5  5  4  5  1  13  1  With  the  on-set  of  IPTs.  the  PCO'ACO  and-PM  should 


be  mergeu  at  the  executive  level  to  ensure  a  pu  per  team 
arrangement  1  think  a  PCO  should  be  certified  as  an  AC<  i 
and  vise  versa  There  should  be  a  recertification  process, 
e  g.,  a  one  day  seminar 

5  4  4  1  7  3  5  Presently.  I  don't  think  enough  tmic  has  elapsed  to  assess 


what  is  in  place. 
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Table  E-5.  Comments  to  Open  Ended  Questions  (Continued' 


III.  CERTIFICATION  PROGRAM  AND  ESTABLISHED  STANDARDS 
1.0  EXPERIENCE  STANDARDS  -  COMMENTS  AND  CONCERNS 


No. 

17244 


17312 


17.330 


Demographics 


]  74**7  1  -  -  4  1  2  !  2 


-  -  3  3  4  2  1  3  3  2 


17679  4  -  -  5  2  1  1  7  3  4 


Comments 

Private  industry  experience  is  also  a  good  method  of 
acquiring  etcpenence  personnel  in  DOD  procurement 
I  have  tound  personnel,  who  have  at  least  some  expenenee 
in  the  operational  squadrons,  possess  invaluable  skills  dealing 
with  short  lead-times,  emergencies,  changes  in  specifications, 
delays  and  the  effects  of  changes  on  schedules  and  prices 
An  individual  could  be  grandfathered  if  they  have  greater 
than  1 0  years  of  expenenee  as  of  1  Oct  9 1 .  this  does  not 
equate 


17694 


-412121  2  Newcomers  to  the  career  ficid  are  dangen  us  nuheii  la^k 
ot  experience  on  how  contracting  is  run 

|l7.->22  -  3  -  3  5  3  1  7  3  6  People  with  the  most  training  after  minimal  experience 

receive  highest  certification  level. 

3  3  4  2  1  3  3  2  As  expenenced  in  my  working  arena,  this  is  being 
circumvented  by  management  who  fabricate  prior 
expenenee  to  help  individuals  qualify  for  the  ten  year 
exception. 

-  5  2  1  1  7  3  4  A  look  at  the  AE  Contracting  Summary  for  Cols  Lt  Cols 
experience  shows  about  1 9°  0  of  the  Cols.  Lt  Cols  with  less 
than  4  years  expenenee.  Who  is  white  washing  this 
program  by  granting  position  certification  waivers  for  all 
these  positions'.' 

-  5  2  5  1  1  1  1  The  recent  changes  in  experience  requirements  were 


lit*  •  -  '  I  .*•>*  I  *  »  **»  — ^  !#..  *  J  tLtfn  »*  *  J.  ....  —  -  *  ' -  »  . -  -  -  .  ....  -  J  .  4 
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the  education  and  train  me 


2.0  TRAINING  STANDARDS  -  COMMENTS  AND  CONCERNS 


No, 

17228 


Demographics 


Comments 

Most  ot  the  important  topics  are  addressed  by  available 
courses;  however,  the  quality  of  matenal  and  instructors  is 
so  variable  that  sometime  the  courses  are  wonderful  and 
sometimes  they  are  a  total  waste 
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Table  £-5.  Comments  to  Open  Ended  Questions  (Continued) 


-  -  4  4  5  1  16  3  1  An  overall  theme  is  that  training  should  be  customer  support 
as  your  survey  indicated.  I  continue  to  see  emphasis  on 
individual  "kingdoms"  at  the  office.  If  everyone  s  single 
goal  were  customer  support,  those  kingdoms  and  turf  battles 
would  go  away.  Our  training  programs,  coupled  with 
emphasis  on  supervisory,  must  be  stressed  if  we  are  truly 
seeking  a  work  force  that  emphasizes  customer  support. 

We  need  to  be  motivated  and  understand  the  benefits  of 
providing  good  customer  suppoit. 

3  6  6  5  1  3  3  5  Training  is  a  good  supplement  to  education  and  experience 
requirements. 

4  4  4  1  1  2  3  1  Required  courses  are  adequate  in  subject  and  number  for 
the  certification  program. 

4  4  4  1  1  o  3  4  Being  a  <  \  <  in  three  years  based  on  a  training  piogr.im 
a  joke  It  happened  to  me  and  I  seriously  feel  that  the 
governments  interest  are  sometimes  at  undue  risk  Due  to 
the  "teaming  concept."  COs  are  becoming  PC  O' ACO  Price 
.Analysts/Property  Administrators  More  property  and 
pricing  classes  required. 

4  4  7  4  1  6  3  7  Contract  specialist  should  not  necessarily  be  moved  from 
a  position  but  strong,  knowledge  PCOs  should  be  mov«  d 
moved  around  so  tnat  contract  specialists  hare  the  benefit 
of  learning  from  them. 

-  4  1  1  13  12  1  attended  MDAC  Basic  and  then  was  told  1  could  not 
aUond  operational  level  contracting  Why''  Are  they  the 


4  4  7  4  16  3 


17318  1  -  -  4  1  1 


same  class 


17332  6  -  -  4  4  4  1  2  4  7  Many  of  the  more  seasoned/ experienced  feel  that  their 

experience  should  waive  .some  ui  the  ‘naming,  anu  i  concur 


I  7459  2  -  -  4222632  Rotational  training  is  not  equivalent  across  the  hoard 

before  1  ever  reported  to  the  job  It  is  difficult  to  understand 
a  class,  if  you  have  no  idea  what  a  PR  or  the  FAR  is  1 
also  fee)  that  it  is  difficult  to  teach  any  of  the  classes  due  to 
the  wide  range  of  experience  and  education  levels  What 
one  person  thinks  is  difficult,  is  easy  for  another. 

17615  -  -  3  5  4  1  16  3  2  It  is  the  problems  of  contracting,  not  the  rules  that  mess  up 

contracting. 

17627  -  -  5  5  5  5  1  6  3  2  For  operational  contracting,  courses  similar  to ’hose  offered 

hv  Georue  Washington  l  niversitv  would  enhance  the 
training  program 

17(>53  -  -  5  5  6  1  14  4  3  Have  received  benefit  from  all  training  All  course  material 

not  necessanlv  applicable,  but  some  benefit  ahvavs  named 
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Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 

1 7497  1  -  -  5  2  2  1  6  1  2  There  needs  to  be  a  greater  number  of  slots  lor  those  who 

may  need  to  get  certified,  but  they  have  their  experience  to 
to  fall  back  on.  The  new  students  only  have  what  they  have 
in  classes. 

17536  -  4-  353122  6  More  classes  need  to  be  added.  With  DAU  funded  training 

if  there  courses  that  are  not  part  of  APDP  they  won't  pay 
and  Ah'  has  limited  funds,  which  means  not  all  training  is 
always  available. 

1 7544  -  -22521  332  We  cannot  get  enough  training  that  is  geared  towards 

operational  matters.  And  if  it  is  available,  the  GS  1 1  &  12's 
get  priority.  Why  not  let  the  trainees  (GS  5-9)  get  the  baste 
training.  By  the  time  your  an  1 1  or  12  you  should  know  your 
job. 

175'.".)  -  -  1  3  2  3  1  2  1  4  \\  e  are  not  sent  to  training  in  a  ninety  manner  I  spent  nn 

money  on  college,  now  it’s  their  turn  to  spend  monev  on 
my  mandatory  training  requirements.  Why  do  you  send 
people  to  training  when  they  cannot  perform  on  the  job 
much  less  perform  in  a  classroom  environment'1 

17616  -  -  4  5  4  1  i  6  3  i  it  should  be  easier  to  get  the  classes  you  need 

17652  -  5  -  3  4  5  1  3  3  2  All  pre  and  post  contract  administration  were  beneficial 

However,  they  were  received  years  after  1  had  experience 
in  this  area  In  my  10  years  of  experience,  the  enlisted  force 
receives  all  the  training  after  the  officers  and  civilians 

17655  -  -  2  4  3  1  1  3  2  2  The  training  slots  are  not  always  readily  available. 

17658  -  -  ]  2  4  5  1  3  2  2  Current  training  programs  should  be  offered  as  early  as 

possible  in  a  contracting  career  progression  manner 

17664  -  -  4  5  4  1  15  3  2  Make  it  easier  to  get  non-APDP  certification  classes 

1  7675  4  -  -  5  4  3  2  7  3  4  Need  to  he  able  to  get  training  with  having  to  go  looking  tor 

it.  1  have  not  received  any  training  through  the  system  hut 
by  going  straight  to  the  training  monitors  at  Randolph. 

17682  -  -5  6  65164  7  The  reward  system  employed  by  the  Air  Force  to  give  the 

OPM  courses  to  a  chosen  few'  is  insulting  I’ve  waned  nine 
years  for  a  course  I  have  repeatedly  requested  and  needed 
only  to  see  other  individuals  and  1  get  "bupkus." 

17694  3  -  -  5  2  5  1  1  1  1  The  real  problem  is  the  availability  of  training  courses.  Upon 

completion  of  this  course  (K  Law),  I  will  have  met  most  of 
the  requirements  for  level  U.  however,  due  to  the  non¬ 
availability  of  contract  pricing.  1  wili  remain  a  level  u  This 
is  not  an  acceptable  situation 

17715  -  -  3  4  3  1  1  2  2  5  Availability  is  poor  1  waited  three  years  to  get  Contract 

Law. 
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Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


2.2 

No. 


17740 


17766 


7233 


TRAINING  APPLI 
Demogra 

-  -  4  4 


17234 


17247 

17249 

17254 

17264 

17260 


-  4 


2  4 


4  3 

5  4 
3  2 
14 

21 


5  112  3 


5  1 


phics 


5  5  15 


Training  is  provided  to  the  contract  work  force  only  when 
mandated,  not  when  the  individual  needs  the  training  to 
effectively  perfonn  their  job.  Training  courses  are  a  must 
and  you  should  not  have  to  wait  long  periods  of  time  to  get 
them  and  yet  be  expected  to  get  the  job  done  efficiently 
^  As  an  enlisted  member  in  contracting,  it  is  frustrating  and 
disheartening  to  have  earned  a  degree,  still  seek  higher 
education  off  duty,  but  have  to  compete  for  scarce  training 
slots  with  'individuals  who  are  simply  going  through  the 
motions. 


C  ABILITY 
Comments 

2  Making  courses  that  may  not  be  relevant  mandatory  results 
in  unnecessary  effort  spent  on  classes  Find  out  what  the 
contracting  work  force  is  actually  dealing  with  and  address 
needs,  necessary  and  desirable  training,  and  improvements. 
Mandatory  courses  should  address  general  real  world 
situations.  Other  courses  should  address  specialized  real 
world  situations.  Should  be  revised  and  tailored  to  tit  the 
needs  of  the  customers.  Make  only  what  is  generally 
necessary  mandatory.  Mandatory  courses  should  have 
particular  value  for  general  contracting  population. 

3  It  is  my  expenence  that  too  often  courses  need  to  be 
geared  to  not  only  beginners  (who  may  have  an  idea  what's 
going  on;,  journeymen  (who  have  a  good  idea  what's  going 
on)  and  under  'grads  (who  either  know  it  all  or  have  been  so 
far  removed  for  so  long,  that  they're  no  better  offer  than 
the  beginner). 

2  The  training  would  be  focused  to  the  specific  organizational 
mission  and  identified  problems  within  the  organization 

3  Need  to  gear  to  specific  jobs  -  systems  acq  vs  operational. 

2  I  feel  more  attention  should  be  given  to  base  level  items 
2  Courses  should  be  directed  tothe  level  of  contracting  you 

are  performing- 

2  Often,  training  is  not  specialized  to  level  of  contracting 
performed. 
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17261 


17264 


17265 


17289 


17310 


1  7536 


17570 


17596 


17622 


Table  r-5.  Comments  to  Open  Ended  Questions  (Continued) 


-254 


n  I  -N 

-  ~  -  3  1  _ 


■5-443 

16  3 

-'-'5465 

r  2  4 

■  -  6  6  7  7 

2  1  4 

-  4  -  .3  5  3 

12  2 

-  -  1  4  3  3 

12  2 

-  -  2  2  4  3 

1  2  3 

-  -  1  32  3 

1  2  i' 

--  5  5  6  5 

2  7  4 

1  2  1  would  like  to  see  the  training  requirements  he  geared  to  the 

level  of  contracting.  If  I  am  working  operational  level 
contracting  and  take  classes  geared  to  systems  level.  I 
wonder  if  l  will  get  job  specific  training.  Then  if  1  were  ever 
to  get  a  transfer  to  a  systems  level  assignment  would  1  not 
then  'need  a  refresher  course  that  was  systems  level 
specific. 

2  2  It  is  a  waste  of  time  and  government  money  to  send  people 

to  courses,  teaching  matenal  they  do  not  need  and  will  not 
use.  Courses  should  be  instructive  and  directed  to  the  type 
of  contracting  one  is  doing.  Delete  those  net  necessary 
to  job.  Base  level  pneing  is  sufficient  for  small  purchases. 

I  don’t  think  the  mtermedicate  pricing  course  should  be 
required  for  base  level  contracting 

1  2  Things  people  leam  in  class  really  don't  help  them  in  their 

job  because  they  don’t  use  it  very  often,  if  even  at  all 

3  2  Make  training  relate  vourjoh  assignment  not  an  across  the 

board  level  rating  based  on  rank  oi  grade 

4  3  Most  training  and  formal  education  does  not  teach  one  how 

to  do  contracting.  Most  of  the  theory  taught  does  not  relate 
to  the  workplace 

4  3  Some  of  the  mandatory  courses  are  a  joke  They  do  not 
even  deal  with  the  central  issues  and  requirements  of  the 
subject,  e.g.  Executive  Administration  never  even  opened 
the  EAR  to  the  relevant  material,  spent  most  of  the  time  on 
touchy-feely  fluff 

2  6  Program  must  meet  all  areas  of  contracting,  operational. 

Rdc  D.  Central  Systems,  perhaps  separate  requirements  for 
each  area 

2  2  Although  the  training  is  given,  how  we  arc  supposed  to  do  it. 

reality  at  the  job  is  not  how  its  done 

3  2  The  training  classes  are  adequate  It's  the  application  and 

performance  once  I  return  home 
1  4  The  government  requires  us  to  have  education,  but  they 
don’t  fulfill  their  end  of  the  training  requirements 

4  2  Most  required  classes  are  so  general  no  "real"  information 

is  gained  The  classes  offer  a  side  benefit  which  is  truly 
worthwhile  the  interaction  of  students  at  lunch,  after-hours, 
etc  Most  of  the  class  material  is  too  basic,  too  general, 
or  inapplicable  to  'experienced  professionals  " 


Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


1 7639  -  -  54  5  51543  No  formal  course  is  going  to  give  the  person  the  knowledge 

he/she  needs  to  sit  at  the  desk  and  do  the  job  Formal 
courses  are  helpful  in  providing  information  overviews  that 
give  the  person  familiarity  with  terms,  rules,  and  general 
procedures.  Doing  the  work  is  what  makes  the  learning 
stick.  Too  many  people  in  contracting  today  seem  to  have 
the  attitude  that  formal  training  is  a  panacea  for  all  our 
problems  -  problems  that  stem  from  promoting  unqualified, 
inexperienced  people  into  contracting  jobs.  It  seems  to  me 
that  this  is  because  many  of  the  people  making  these 
decisions  fall  into  that  category  themselves. 

1 7646  -  -  4  3  631632  Rather  than  mandatory  classes  for  i  1 02’s  why  not  classes 

for  specific  areas  -  i.e.,  if  I'm  an  administrator  send  me  to 
admin,  by  the  time  1  am  assigned  to  a  job  to  use  some  of  me 
class  info,  so  much  time  has  eiapsed  that  what  hasn't 
changed  I've  forgotten.  Also  training  is  almost  always 
systems"  oriented.  I  only  need  operational  contracting 
training. 

(  . . .  v 

1 7655  -  -  2431  13221  feel  certain  courses  should  be  pre-requisites  for  other 

course,  'i.e.  MDAC  basic  before  cost  and  pricing. 

17699  -  5-  465163  2  There  needs  to  be  mandatory  classes  established  for 

enlisted  grades  to  ensure  attendance  and  completion 

17700  -  -  4  2  6  4  1  1  1  4  Much  of  the  training  is  geared  for  central  contracting  Not 

a  lot  for  base  level  contract,  EFP.  In  1 5  years  of  eon  acting 
I  have  never  dealt  with  any  contracts  other  than  FFP 

17740  -  -  2  4  5  i  1  2  3  2  Requiring  operational  contract  specialists  to  train  in  areas 

only  required  by  systems  contract  specialists  is  unfair  and 
and  does  nothing  to  help  ensure  operational  personnel 
provide  effective  customer  support  Civilians  in  the  held 
take  a  back  seat  on  training  requirements 


2.3  TRAINING  NEEDS  AND  SUGGESTIONS 


No.  Demographics  Comments 

1 7229  -  -  2  4  4  1  1  2  1  2  More  Base  level  courses. 

1 7235  -  -  4  4  71  1  5  351  believe  the  CAS  courses  should  be  mandatory  because  it 

is  a  law  that  needs  to  be  understood  by  acquisition  officials 
1  have  had  experience  w'here  PCO's  directed  contractor’s 
to  violate  ('AS  without  knowing  the  impact  ol  their 
directions 

17236  -  -  2  5  2  1  15  2  2  Training  in  cost  proposal  evaluation  and  source  selection _ 


17238 


1 7240 


17247 


17285 


17297 


117254  - 


17268  - 


Table  E-5. 
4  6  6  115 


3  2  3  1 


Comments  to  Open  Ended  Questions  (Continued) 

3  1  Allows  the  level  3  courses  to  be  made  available  to  aspiring 
level  2  personnel.  This  would  enable  one  to  prepare  for 
upward  positions 

3  1  Allow  some  of  the  training  requirements  to  be  completed 

by  correspondence. 

4  2  Recommend  trained  team(s)  of  1 1 02s  be  developed  for  the 

purpose  of  going  to  the  field  to  provide  OJT  training. 

All  training  classes  are  beneficial,  but  the  workshop 
environment  is  much  more  conducive  to  learning,  especially 
working  joint  case  problems  with  plenty  of  question  and 
answer  time. 

1  2  I  feel  each  level  should  have  1  -2  base  level  elective  type 
courses  for  'rtification.  This  would  give  the  Contract 
Administrator  the  bigger  picture  as  wcil  as  u  hat  is 
happening  at  base  level 

1  2  I  think  that  some  formal  training  classes  should  be  given  on 
specific  subjects  like  supplies,  or  services  or  BCAS  and 
how  to  input  different  contract  types  correctly.  Specific 
classes  for  different  sections.  Most  classes  are  related  to 
the  construction  branch  and  are  not  as  beneficial  to  people 
working  in  supplies  or  services 

1  2  1  have  not  had  the  chance  to  attend  too  many  schools,  but  1 

don't  believe  there  is  any  classes  on  contingency  contracting 
and  as  a  military'  member  -  this  might  standardize  how  (\)'s 
handle  different  situations 

3  2  Allow  senior  NOO's  with  degrees  and  experience  the 
opportunity  to  achieve  level  Ill  by  opening  more  slots  or 
exec  courses 

2  2  Classes  should  be  longer  There  is  so  much  valuable 

information  it  is  hard  to  absorb  in  the  short  few  weeks  the 
classes  run 

3  2  Training  is  sometimes  given  too  early  in  ones  career  When 

you  are  brand  new  you  don't  even  remember  what  F  AR 
stands  for  let  alone  applying  conceptual  ideas  learned  in  a 
classroom  to  the  real  world  at  your  desk.  First  some  OJT. 
then  classes  would  be  more  beneficial  -  mean  more  to  you 
I  think  more  training  classes  that  cover  other  areas  of 
contracting  would  help  to  round  out  a  persons  knowledge 
base  on  the  overall  contracting  field  That  would  help  to 
the  "big  picture"  of  how  procujemenl  contributes  to  the 
overall  mission 
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Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


17298 

17316' 


17332 


17527  - 
1 7535  - 
17607  - 

17621 


1 7630 
17634 

1 7657 


17658 

17662 


4  4 


-  4  4  4 
5-45 


2  1 


4  2 


6  3 


3 
3  2 


Need  more  property  classes. 

Less  emphasis  on  assembly  line  training.  By  level  II  we 
should  start  seminar  based  programs  with  emphasis  on 
learning,  not  tests  Also,  should  include  discussion  on 
mission  needs,  why  we  are  here,  and  the  importance  of 
procurement  within  DOD. 

I  think  training  is  not  adequate  when  it  comes  to  negotiation 
techniques,  style  as  well  as  communication.  Negotiations 
and  communication  are  an  integral  prut  from  beginning 
through  all  management  positions.  One  is  continually- 
negotiating  for  contracts,  terms  manpower,  labor  relations, 
etc.  Truly  'effective  communication  is  critical  Many 
people  are  simply  are  lacking  in  the  communications  arena. 

3  3  2  Opportunity- in  related  occupations  after  those  requiring 
mandatory'  training  have  been  instructed. 

7  3  6  Certification  requirements  should  require  both  pie  and  post 
award  courses  since  we  are  cradle-to-grave. 

Basic  classes  should  not  be  scheduled  so  early  in  the  career 
because  you  have  no  idea  what  they  are  talking  about,  wait 
6  months  so  they  have  a  basic  idea  of  what  an  acquisition  is. 
The  training  being  provided  might  be  more  beneficial  if  more 
time  could  be  spent  learning  rather  than  just  cramming 
information  in.  (Too  much  information  covered  in  too  short 
a  period  of  time ) 

1  would  prefer  to  sec  Contract  Law  required  for  level  1 
certification 

Move  Contract  Law  to  level  1.  level  1  to  2  years,  and  add 
both  pie  and  admin  to  level  ill  Aiso  need  decision 
making  in  Contract  Management 

Having  frequent  breaks  at  the  work  place  seems  detrimental 
to  my  really  "getting  into  the  business."  It  might  be  a  good 
idea  then  to  have  general  courses  once  one  has  already- 
met  the  certification  qualifications  to  refresh  myself  on  the 
material. 

Perhaps  a  core  in-depth  course  should  be  offered  to  new 
personnel. 

Don't  emphasize  testing  in  classrooms,  hut  rather 
instructional  training  Develop  the  "how  toos"  in  performing 
the  job  Should  requite  advanced  training 
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Tabic  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


3.3  DISSATISFACTIONS  WITH  EDUCATION  REQITREMENTS 
No.  graphics  Comments 

17311  --  52677643  Get  rid  of  the  mandatory  college  degree  requirement 
1 7672  -  -  55652742  De-emphasize  education! 

17699  -  5  -  465  1  63  2  High  grade  civilians  who  enter  programs  on  degrees  don't 

have  mv  respect 
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Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 
IV.  TRAINING  COURSES  PERCEIVED  MOST  BENEFICIAL 


Mo.  Demographics 

Most  Beneficial 

Comments 

17219  - 

- 

4 

4 

5 

1 

1 

4 

3 

4  MDAC-  Basic 

17231  - 

- 

3 

2 

3 

1 

i 

1 

3  ! 

*> 

j 

-  MDAC  -  Basic 

17233  - 

- 

4 

4 

5 

5 

1 

5 

3 

2  MDAC  -  Basic 

17236  - 

- 

2 

5 

2 

1 

1 

5 

2 

2  MDAC  -  Basic 

FAR  familiarization 

17245  - 

- 

3 

4; 

4 

1 

1 

5 

1 

2  MDAC  -  Basic 

Information  could  be  applied  in 

! 

everyday  world. 

17256  - 

2 

- 

2 

2 

l 

1 

2 

2 

2  MDAC  -  Basic 

17260  - 

- 

2 

1 

4 

5 

1 

2 

1 

2  MDAC  -  Basic 

17284  - 

- 

J 

4 

2 

1 

1 

2 

i 

2  MDAC  -  Basic 

17289  - 

5 

- 

4 

4 

1 

6 

** 

2  MDAC -Basic 

Familiarized  me  with  the  i  \R 

1 7292  - 

- 

4 

4 

4 

1 

1 

2 

3 

1  MDAC  -  Basic 

i 

I 

17309  - 

- 

5 

4 

0 

5 

1 

2 

4 

3  MDAC  -  Basic 

17331  - 

- 

5 

2 

6 

7 

2 

7 

4 

3  MDAC  -  Basic 

Covered  a  lot  of  material 

17333  - 

- 

6 

5 

7 

5 

1 

4 

7  MDAC  -  Basic 

17456  - 

- 

2 

4 

2 

7 

2 

3 

2  MDAC  -  Basic 

Most  specific  and  detailed. 

17473  1 

- 

- 

6 

2 

4 

1 

7 

2 

2  MDAC  -  Basic 

17474  - 

- 

1 

5 

1 

1 

1 

2 

1 

2  MDAC  -  Basic 

Good  Overview. 

17651  - 

- 

2 

4 

J 

1 

1 

2 

1 

2  MDAC  -  Basic 

Teaches  the  usage  of  the 

different  regulations  and  manuals 

17657  2 

- 

- 

4 

1 

1 

1 

7 

1 

2  MDAC  -  Basic 

General  coverage  gave  a  strong 

foundation  to  app!\  at  the 

workplace. 

17658  - 

- 

1 

2 

4 

5 

1 

3 

2 

2  MDAC  -  Basic 

17719  - 

4 

- 

4 

4 

1 

1 

2 

3 

7  MDAC  -  Basic 

17327  3 

- 

- 

5 

2 

3 

1 

2 

3 

1  Central  Systems 

Complete  comprehensive 

coverage. 

17623  5 

- 

- 

5 

5 

6 

2 

7 

4 

6  Central  Systems 

Most  helpful  since  it  was  my 

.-■j 

1 

introduction  to  the  contracting 

1 

career  field. 

17628  3 

- 

- 

5 

4 

4 

1 

7 

4 

7  Central  Systems 

Taught  me  contracting 

i 

1 

i 

fundamentals. 

17228  - 

5 

6  4 

5 

1 

5 

3 

5  Operational  Contracting 

1 

17457  1 

- 

- 

4 

1 

1 

1 

3 

! 

2  Operational  Contracting 

Gave  me  a  better  understanding 

of  the  job. 

17471  1 

- 

- 

4 

1 

1 

I 

2 

1 

2  Operational  Contracting 

17563  - 

- 

-» 

0 

_5_ 

4 

4 

1 

2 

3 

2  Operational  Contracting 

I 
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Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


17231  -  -  3  2 

3  1 

1  3  3 

-  Principles  of  Pricing 

Directly  applicable  to  my  job. 

1 7246  -  -  4  4 

5  2 

1  5  3 

2  Principles  of  Pricing 

Applicable  to  job. 

17254  -  -  3  2 

3  1 

1  4  1 

2  Principles  of  Pricing 

1 7292  -  -  4  4 

4  1 

1  2  3 

1  Principles  of  Pricing 

17559  -  -  3  4 

5  2 

1  3  3 

2  Principles  of  Pricing 

17566  2  -  -  4 

2  1 

1  2  1 

2  Principles  of  Pricing 

1 7626  3  -  -  5 

4  5 

2  7  3 

2  Principles  of  Pricing 

17627  -  -  :  5  5 

5,  5. 

1  6  3 

2  Principles  of  Pricing 

17688  -  -  2  2 

4  >. 

1  2  2 

2  Principles  of  Pricing 

17765  --24 

2  1 

1  2  2 

1  Principles  of  Pricing 

Helped  me  understand  the 

1  |  .  ! 

1 

process  better. 

17220  -  -  3  1 

7  5 

1  2  3 

2  Base  Level  Pricing 

17356  -  2  -  2 

2  1 

I  2  2 

2  Base  level  Pricing 

1 7260  -  -  2  1 

4  5 

1  2  1 

2  Base  Lev  el  Pricing 

17289  -  5  -  4 

4  3 

l  6  3 

2  Base  Levei  Pricing 

Related  to  current  job 

assignment. 

17537  -  3  -  4 

3  1 

1  7  1 

6  Base  Level  Pricing 

17238:-  -  4  6 

6  1 

1  5  3 

1  Def  Cost  &  Price  Analysis 

17299  -  -  44 

7_4 

1  6  3 

7  Def  Cost  &  Price  Analysis 

Price/Cost  savings  is  extremely 

important;  we  must  know  Mow 

to  go  about  it. 

17233  -  -  4  4 

5  5 

1  5  3 

2  Contract  Law 

17261  -  -  2  5 

4  1 

1  3  1 

2  Contract  Law 

17264  -  -  '  I  4 

4  1 

1  2  2 

2  Contract  Law 

I  learned  tilings  which  1  found 

very  applicable. 

17269  -  -  2  2 

3  1 

1  2  1 

2  Contract  Law 

Learned  a  lot  about  siovemment 

rights  and  how/why  we  have 

those  rights. 

17270  -  2  -  2 

3  1 

1  2  1 

2  Contract  Law 

17280  -  2  -  2 

3  1 

12  1 

2  Contract  Law 

17285,-  ,2.-  .2 

3  1 

1 

1  3.2 

2  Contract  Law 

It  is  important  to  know  what 

you  can  and  cannot  do. 

17294'-  !  4|  4 

4,  1 

1  6i  3 

3  Contract  Law 

17305  -  4  -  3 

4  4 

1  63 

2  Contract  Law 

Case  studies  allow  you  to  see 

!  .  :  1 

how  some  of  the  concepts 

actually  work. 

17312  -  -  54 

6  5 

2  o  4 

3  Contract  !  aw 

Gave  historical  view  on  how  we 

contract  &  current  rational  for 

ways  to  handle  changes 

L>39 


Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


17567  - 

2 

4 

1 

i 

2  3 

2  Contract  Law 

17568  - 

- 

4 

4 

3 

i 

3  1 

6  Contract  Law 

1 7622  - 

- 

5 

5 

6 

5 

2 

7  4 

2  Contract  Law 

Provides  fundamentals 

applicable  to  all  contract!;. 

17624'  3 

-  ' 

- 

5 

4 

5 

2 

7  3 

2  Contract  Law 

Case  studies  similar  to  actual 

' 

conditions. 

17626  3 

- 

- 

e 

4 

5 

2 

7  3 

2  Contract  Law 

17627  - 

- 

5 

5 

5. 

5, 

1 

6  3 

2 1  Contract  Law 

17634  4; 

- 

-  ; 

64 

6 

2: 

7  4 

2  Contract  Law 

17645  - 

5 

- 

J 

■*> 

3 

3 

1 

6  2 

2  Contract  Law 

17646  -  ' 

-  ■ 

4 

2 

6 

n 

3 

1 

6  3 

2  Contract  Law 

Took  it  just  when  1  was  on  o  job 

! 

that  1  could  really  use  the 

information  picscntcd. 

1 7647  - 

- 

2 

1 

4 

4 

1 

2  3 

2  Contract  Law 

Now  know  more  when  ieuals 

state  a  contract  is  legal K 

sufficient. 

17762  - 

- 

1 

4 

4 

1 

1 

2  2 

1  Contract  Law 

Can  be  applied  to  my  immediate 

i 

-  T  ^ 

— r 

“1 

17766  - 

4 

- 

4 

2 

5 

1 

2  1 

2  Contract  Law 

17768  3 

- 

- 

6 

2 

1 

1 

1  2 

1  Contract  Law 

Provides  fundamentals 

17238  - 

- 

4 

0 

6 

1 

I 

5  3 

1  intermediate  Pricing 

17246  - 

- 

4 

4 

5 

2 

1 

5  3 

2  Intermediate  Pricing 

17219  - 

- 

4 

4 

5 

1 

1 

4  3 

4  MDAC  -  Advanced 

17220  - 

- 

3 

1 

7 

5 

1 

2  3 

2  MDAC  -  Advanced 

Subject  matter  closely  related 

i 

to  job. 

17233  - 

- 

4 

4 

5 

5 

1 

5  3 

2  MDAC  -Advanced 

«  n  a  c 
a  >  - 

_ 

_> 

.1 

"T 

.1 

“T 

1 

1 

1 

<  r 

■j  i 

K,ir^/W' 

4*  1  »  ■  L.r  (  » V  i  IVitUIlVVU 

ItiiVMTimivn  CO'r-H  IH 

everyday  world. 

17274  - 

4 

- 

4 

5 

5 

1 

6  3 

2  MDAC  -  Advanced 

17291  - 

- 

4 

4 

4 

1 

1 

2  3 

3  MDAC  -  Advanced 

, 

17292  - 

4 

4 

4 

1 

1 

2.3 

1  MDAC  -  Advanced 

; 

17293  - 

3 

4 

4 

3 

1 

2  3 

2  MDAC  -  Advanced 

17330'- 

- 

3 

2 

5 

3 

1 

2:3 

3  MDAC  -  Advanced 

Well  rounded  information 

1 

! 

1 

1  provided  for  both  pre  and  post 

' 

i 

award. 

17331  - 

- 

5 

2 

6 

7 

2 

7  4 

3  MDAC  -  Advanced 

overed  a  lot  of  material. 

17459  2 

- 

- 

4 

2 

2 

2 

6  3 

2  MDAC  -  Advanced 

17570  - 

- 

2 

2 

4 

3 

I 

2  3 

2  MDAC  -  Advanced 

17719  - 

4 

4 

4 

i 

i 

2  3 

7  MDAC  -  Advanced 

I 
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Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


17221 

- 

-  : 

4 

5 

4 

1 

1 

6 

3 

3  Advanced  Administration 

17222 

- 

- 

4 

4 

4 

1 

1 

8 

3 

3  Advanced  Administration 

Discussion  of  cases  very 

beneficial. 

17230 

- 

4 

4 

5 

1 

1 

6 

3 

1  Advanced  Administration 

Received  good  DCMC 
perspective,  gave  balance  to  my 

perspective  as  a  buyer/CO. 

17254 

- 

- 

3 

2 

.5 

1 

1 

4 

i 

2  Advanced  Administration 

17273 

- 

4 

- 

2 

4, 

1 

1 

3 

i 

2  Advanced  Administration 

17286 

4 

- 

5 

4 

4 

1 

7 

3 

7  Advanced  Administration 

17306 

- 

2 

- 

1 

4 

1 

1 

2 

3 

2  Advanced  Administration 

17312 

- 

- 

5. 

4 

6 

5' 

2 

6 

4' 

3  Advanced  Administration 

It  allows  in-depth  discussions  on 

topics  which  cause  most 

contracting  problems 

17324 

- 

- 

2 

1 

2 

1 

l 

2 

1 

5  Advanced  Administration 

i 

17419 

o 

- 

- 

4 

4 

4 

*> 

2 

o  Advanced  Administration 

Hands  on. 

17525 

3 

- 

- 

6 

4 

5 

1 

6 

"7 

3  Advanced  Administration 

17559 

- 

- 

3 

4 

5 

2 

1 

** 

2  Advanced  Administration 

1 7634 

4 

- 

6 

4 

6 

2 

7 

4 

2  Advanced  Administration 

17220 

- 

-v 

1 

7 

5 

1 

2 

sy 

2  Base  Administration 

1 7229 

- 

2 

4 

4 

1 

1 

2 

i 

2  Base  Administration 

Work  operational,  course  was 
tailored  to  daily  operations. 

17283 

- 

- 

1 

3 

4 

1 

1 

3 

i 

2  Base  Administration 

17297 

- 

- 

"> 

4 

4 

1 

1 

6 

3 

2  Base  Administration 

Addressed  real  situations,  not 

just  conceptual. 

17644 

- 

3 

- 

2 

2 

5 

1 

.7 

2 

1  Base  Administration 

Studied  clauses. 

17298 

- 

- 

4 

4 

4 

1 

1 

6 

3 

4  Overhead  Management 

- 

17219 

- 

- 

4 

4 

5 

! 

1 

4 

■% 

A  i  ^nOrba'i/)  Nilnnnuntvtnts* 

*  v  i  vinwuu  i  f  iuiiu^wi  1 1 V  •! 

17222 

- 

- 

4 

4 

4 

1 

1 

8 

3 

3  Overhead  Management 

17316 

- 

5 

4 

5 

5 

1 

4 

3 

4  Executive  Contracting 

Current  procurement  topics 

and  the  big  picture  approach. 

17627 

- 

5 

5 

5 

5 

1 

6 

3 

2  Executive  Contracting 

17221 

- 

- 

4 

5 

4 

1 

1 

6 

3 

3  Value  Engineering 

17234 

- 

- 

2 

4 

4 

3 

1 

1 

3 

3:  Negotiation  Workshop 

Class  was  good  practice. 

17247 

- 

- 

4 

3 

6 

4 

1 

7 

4 

2  Negotiation  Workshop 

17537 

- 

3 

- 

4 

3 

1 

1 

7 

1 

6  Contract  Placement 

17567 

- 

_*> 

- 

2 

4 

1 

1 

2 

3 

2  Contract  Placement 

17627 

- 

- 

5 

5 

5 

5 

1 

6 

7 

2  C  ontract  Placement 

17645 

- 

5 

- 

*■* 

A 

'S 

J) 

I 

6 

2 

2  Contract  Placement 

1 7260 

- 

- 

2 

1 

_4_ 

5 

1 

2 

1 

2  Property  Management 

Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


V.  TRAINING  COURSES  PERCEIV  ED  LEAST  BENEFICIAL 


No."  ' 

Demographics 

Least  Beneficial 

Comments 

17230 

-  -  : 

4  4 

5 

1 

1 

6 

3 

1  MDAC  -  Basic 

17234 

2.4 

4 

3'1 

1 

1 

3' 

3 ;  MDAC  -  Basic 

Course  was  too  advanced  for 

1 

:  i 

! 

1 

“T 

1 

someone  with  no  experience 

17246 

-  - , 

4  4 

5 

2 

1 

5 

3 

2  MDAC  -  Basic 

17264 

-4 - -j 

4 

1,1 

2! 

2: 

2:  MDAC  -  Basic 

I  was  already  familiar  with  the 

■’ 

L 

\ 

1 

i 

! 

i 

1 

1 

FAR  and  DFAR 

17273 

-4 

-'■2 

4' 

1 

1 

3- 

1 

2  MDAC  -  Basic 

17317 

6.  - 

- 1  5' 

!'■ 

6 

2' 

7' 

4  4  MDAC  -  Basic 

Should  have  a  minimum  of  six 

“l 

months  hands  on  before 

attending. 

17570 

-  - 

2  2 

4 

3 

1 

2 

3 

2  MDAC  -  Basic 

17627 

-  - 

5  5 

5 

5 

I 

6 

3 

2  MDAC -Basic 

17646 

’  - 

4  2 

6 

3 

1 

6 

3 

2  MDAC  -  Basic 

17647 

2  1 

4 

4 

1 

2 

3 

2  MDAC  -  Basic 

17419 

3  - 

-  4 

4 

4 

2 

7 

2 

6  i  Operational  Contracting 

Too  broad,  difficult  to  apply. 

17537 

-  3 

-  4 

3_ 

r 

1 

7 

1 

6  Operational  Contracting 

17566 

2  - 

-  4 

2 

1 

1 

2 

1 

2  Operational  Contracting 

17221 

-  - 

4  5 

4 

1 

1 

6 

3 

3  Principles  of  Pricing 

Not  pertinent  to  job. 

17291 

-  - 

4  4 

4 

1 

1 

2 

3  Principles  of  Pricing 

17306 

-  2 

-  1 

4 

1 

1 

2 

2  Principles  of  Pricing 

17327 

n 

- 

-  5 

2 

n 

.V 

1 

2 

.V 

1  Principles  of  Pricing 

Subject  coverage  was  too  basic 

for  college  graduate  -  should  be 

i  week. 

17464 

1  - 

-  (> 

2 

4 

1 

n 

/ 

2 

2  Principles  of  Pricing 

Not  designed  for  the  type  of 

work  1  do 

17473 

-  - 

i  5 

1 

1 

1 

Z 

1 

2  Principles  of  Pricing 

17628 

2>  - 

-  5 

4 

4 

1 

7 

4 

7  Principles  of  Pricing 

Very  little  application  to  job. 

17647 

•  •21 

4 

4 

1 

- 

2,3 

2  j  Principles  of  Pricing 

.  1 

17269 

-  - 

;  2. 2 

3 

1 

1 

2 

I 

2 :  Base  Level  Pricing 

1  do  very  little  negotiations  that 

i  : 

.  1 

1 

require  cost  breakdown  of 

1  : 

i  i 

i 

contractors  proposals. 

17297 

-  - 

1  3 ' 4 

4 

1 

1 

6 

3 

2  Def  Cost  &  Price  Anal}  sis 

'  Better  for  price  analysts,  too 

much  detail. 

1 7330 

-  - 

3  2 

5 

3 

1 

*> 

3 

3  Def  Cos!  &  Price  Analysis 

Too  in  depth  for  a  new  specialist 

Should  be  taken  after  many 

years  in  contracting. 

Table  E-5.  Comments  to  Open  Ended  Questions  (Continued) 


17231 

- 

- 

T 

T 

3 

T 

T 

^  2) 

-  Contract  Law 

Still  have  to  refer  legal  matters 

to  lawyers  anyway. 

17236 

- 

- 

2 

5 

2 

I 

i 

5  2 

2  Contract  Law 

17245 

_  . 

3 

4 

4 

1 

i 

5  1 

2  Contract  Law 

Poor  instructors,  material  not 

presented  well. 

17254 

- 

- 

3 

2 

3 

1 

i 

4  1 

2  Contract  Law 

17286 

4 

- 

- 

5 

4 

4 

7,  3. 

7  Contract  Law 

17289 

5 

- 

4' 

4 

3 

i 

6‘  3 1 

2  Contract  Law 

If  I  need  legal  advice,  I  go  to 

a  lawyer. 

17293 

- 

4 

4 

3 

i 

2  3 

2  ' Contract  Law 

Bad  Instructor 

17333 

- 

- 

6 

5 

7 

5 

i 

2  4 

7  Contract  Law 

17455 

- 

- 

4 

1 

] 

2  1 

2  Contract  Law 

Needed  more  focus  on 

government  contracts. 

17719 

- 

4 

- 

4 

4 

1 

i 

2  3 

7  Contract  Law 

17527 

- 

- 

4 

4 

4 

2 

i 

3  3 

2  Intermediate  Pricing 

Related  to  systems  acquisition 

and  not  the  day  to  day  aspects 

: 

of  pricing. 

17246' 

- 

- 

4 

4 

5 

2 

i 

5  3 

2  MDAC  -  Advanced 

17260 

- 

- 

2 

1 

4 

5 

i 

2  I 

2  MDAC  -  Advanced 

17289 

- 

5 

- 

4 

4 

i 

6  3 

2  MDAC  -  Advanced 

Taught  at  systems  level,  not 

base  level. 

17316 

- 

- 

5 

4 

5 

5 

i 

4  3 

4  MDAC  -  Advanced 

Too  mechanical  in  its  approach. 

Instructors  load  out  of  the  hook 

17624 

3 

- 

- 

5 

4 

5 

2 

7  3 

2  MDAC  -  Advanced 

Too  late  in  my  career  to  do  am 

good. 

17634 

- 

- 

/v 

\S 

-1 

*T 

/- 

\J 

7 

1  4 

t  H 

2  MDAC  -Advanced 

17289 

- 

5 

- 

4 

4 

3 

i 

6  3 

2  Advanced  Administration 

17228 

- 

- 

5 

6 

4 

5 

i 

5  3 

5  Overhead  Management 

17312 

- 

- 

5 

4 

6 

5i 

2 

6  4 

3  Executive  Contracting 

17623 

3. 

- 

- 

5  5 

6 

2 

7 ,  4 

6  MDAC  -  Executive 

Gave  rne  no  lew  tools,  just  a 

■ 

rehash  througli  case  study 

17627 

- 

- 

5 

5 

5 

5 

1 

6' 3 

2 'MDAC  -  Executive 

17312 

- 

- 

5 

4 

6 

5 

2 

6  4 

3  Executive  Administration 

1 

17309 

- 

- 

5 

4 

6 

5 

1 

2  4 

3  Value  Engineering 

17229 

- 

- 

2 

4 

4 

1 

1 

2  1 

2  Negotiation  Workshop 

Mostly  common  sense,  could 

be  a  3  day  seminar. 

17270 

- 

2 

- 

2 

3 

1 

1 

2  1 

2  Contract  Placement 

17622 

* 

- 

5 

5 

6 

5 

2 

7  4 

2  Environmental  Contracting 

Too  basic 
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